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IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 



Applicant: Steinberg, et al. 

Title: INTELLIGENT CAMERA FLASH SYSTEM 

Serial No.: Continuation of 08/624,972 

Our File: 29033-0269592 

TRANSMITTAL FOR NEW PATENT APPLICATION 

Box Patent Application 

Assistant Commissioner for Patents 

Washington, D.C. 20231 




Re: Continuation Application 

Sir: 



Enclosed is a new patent application, including: 



1 . New Application Transmittal (16 pages); 

2. Patent application, including 23-page specification, 1 1 pages of claims, 1-page 
abstract and 9 sheets of formal drawing; 

3 . Preliminary Amendment; 

4. Declaration and Power of Attorney (copy from parent case); 

5. Assignment (copy of recorded assignment from parent case); 

6. Small Entity Statement (copy from parent case); 

7. Check No. ^/V?^ in the amount of $458,00 for the filing fee; 

8. Copy of Notification of Continuation Application filed in the parent case; and 
Postcard for date-stamped confirmation of Patent OflFice's receipt of these materials. 




Dated: November 20, 2000 David H. Jaffey u// 

Reg. No. 34^3 ^ 

PILLSBURY MADISON & SUTRO LLP 
2550 Hanover Street 
Palo Alto, CA 94304-1115 
Telephone: (650)233-4510 
Facsimile: (650) 233-4545 



CERTIFICATION UNDER 37 C.F.R. LID 

I hereby certify that this correspondence and the documents referred to as attached hereto are being 
deposited with the United States Postal Service on this date November 20, 2000, in an envelope as 
"Express Mail Post Office to Addressee," mailing Label Number EL596839659US, addressed to the 
Assistant Commissioner for Patents, Washington, D.C. 2023 1 . 




60195934vl 



Practitioner's Docket No. 29033-0269592 



PATENT 



Preliminary Classification: 
Proposed Class: 
Subclass: 

NOTE: *'At{ applicants are requested to include a preliminary classification on newly filed patent 

applications. The preliminary classification, preferably class and subclass designations, should be 
identified in the upper right-hand comer of the letter of transmittal accompanying the application 
papers, for example 'Proposed Class 2, subclass 129. ' " M.P.E.P. § 601, 7th ed. 




IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 

Box Patent Appiication 

Assistant Commissioner for Patents 

Washington, D.C. 20231 

NEW APPLICATION TRANSMITTAL 



Transmitted herewith for filing is the patent application of 
lnventor(s): Eran SteinBerg, Hari Vasudev^ Sumat Mahra 

WARMNG: 37 CRR § 1.41(a)(1) points out: 

"(a) A patent is applied for in the name or names of the actual inventor or inventors. 

"(1) The inventorship of a nonprovisional application is that inventorship set forth in the oath or 
declaration as prescribed by § 1.63, except as provided for in § 1.53(d)(4) and § 1, 63(d). If an 
oath or declaration as prescribed by § 1,63 is not filed during the pendency of a nonprovisional 
application, the inventorship is that inventorship set forth in the application papers filed pursuant 
to § 1.53(b), unless a petition under this paragraph accompanied by the fee set forth in § 1.170 
is filed supplying or changing the name or names of the inventor or inventors." 



For (title): 



INTELLIGENT CAMERA FLASH SYSTEM 



CERTIFICATION UNDER 37 C.F.R. § 1.10* 
f£xp/«ss Mail label number is mandatory,) 
(Express Mail certification is c^tionai) 

I hereby certify that this New Application Transmitta! and the documents r^en'ed XQ^sls ^ached therein are being 
deposited with the United States Postal Service on this date November IV ^ ZUiJK) envelope 
as "Express Mail Post Office to Addressee," mailing Label Number EL596839659US ^ ad- 
dressed to the: Assistant Commissioner for Patents, Washington, D.C. 20231. 

Diana Bearing 



{type or print name of person mailing paper) 



Signature of person mailing paper 

WARNING: Certificate of mailing (first class) or facsimile transmission procedures of 37 C.F.R/§ 1.8 cannot be 
used to obtain a date of mailing or transmission for this correspondence. 

*WARNING: Each paper or fee filed by "Express Mail" must have the number of the "Express Mail" mailing label 
placed thereon prior to mailing. 37 C.F.R, § 1.10(b). 

"Since the filing of correspondence under § 1.10 v^ithout the Express Mail mailing label thereon 
is an oversight that can be avoided by the exercise of reasonable care, requests for waiver of this 
requirement will not be grar)ted on petition. " Notice of Oct. 24, 1996, 60 Fed. Reg. 56,439, at 56,442. 
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1. Type of Application 

This new application is for a(n) 

(check one applicable item below) 

□ Original (nonprovisional) 

□ Design 
□ Plant 

WARNING: Do not use this transmittal for a completion in the US. of an International Application under 35 
US.C. § 371(c)(4), unless the Intemationai Application is being filed as a divtstonal, continuation 
or continuation-in-part application. 

WARNING: Do not use this transmittal for the filing of a provisional application. 

NOTE: If one of the following 3 items apply, then complete and attach ADDED PAGES fOR NEW APPLICATION 
TRANSMITTAL WHERE BENEFIT OF A PRIOR U.S. APPLICATION CLAIMED and a NOTIFICATION 
IN PARENT APPLICATION OF THE FILING OF THIS CONTINUAVON APPUCAVON. 

□ Divisional. 
O Continuation. 

□ Continuation-in-part (C-l-P). 

2, Benefit of Prior U.S. AppHcation(s) (35 U.S.C. §§ 119(e), 120, or 121) 

NOTE: A nonprovisional application may claim an invention disclosed in one or more prior filed copending 
nonprovisional applications or copending intemationai applications designating the United States of 
America, In order for a nonprovisional application to claim the benefit of a prior filed copending 
nonprovisional application or copending intemationai application designating the United States of 
America^ each prior application must name as an inventor at least one inventor named in the later filed 
nonprovisional application and disclose the named inventor's invention claimed in at (east one claim 
of the later filed nonprovisional application in the manner provided by the first paragraph of 35 U.S.C. 
§ 112, Each prior application must also be: 

(i) An intemationai application entitled to a filing date in accordance with POT Article 1 1 and 
designating the United States of America; or 

(li) Complete as set forth in § 1. 51(b); or 

(iii) Entitled to a filing date as set forth m § 1.53(b) or § 1,53(d) and include the basic filing fee set 
forth in § 1.16; or 

(iv) Entitled to a filing date as set forth tn § 1.53(b) and have paid therein the processing and retention 
fee set forth in § 1.21(1) within the time period set forth in § 1.53(f}. 

37 C.FR. § 1.78(a)(1). 

NOTE: If the new application being transmitted is a divisional, continuation or a continuation-in-part of a parent 
case, or where the parent case is an International Application which designated the U.S., or benefit 
of a prior provisional application is claimed, then check the following item and complete and attach 
ADDED PAGES FOR NEW APPLICATION TRANSMITTAL WHERE BENEFfT OF PRIOR U.S, APPLICA- 
TION(S) CLAIMED. 

WARNING: if an application claims the benefit of the filing date of an eariier filed application under 35 U.S.C. 

§§ 120, 121 or 365(c), the 20~year term of that application will de based upon the fifing date of 
the eariiest US, application that the application makes reference to under 35 U.S.C. §§ 120, 121 
or 365(c). (35 U.S,C. § 154(a)(2) does not take into account, for the determination of the patent 
term, any application on which pnority is claimed under 35 U.S.C. §§ 119, 365(a) or 365(b).) For 
a c~i-p application, applicant should review whether any claim in the patent that will issue is 
supported by an eariier application and, if not, the applicant should consider canceling the reference 
to the eariier filed application. The term of a patent is not based on a claim-by-claim approach. 
See Notice of April 14, 1995. 60 Fed. Reg. 20,195, at 20,205. 
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WAf^NING: When the last day of pendency of a provisional application falls on a Saturday, Sunday, or Federal 
holiday within the District of Columbia, any nonprovisional application claiming benefit of the 
provisional application must be filed prior to the Saturday, Sunday, or Federal holiday within the 
District of Columbia, See 37 C.f.R § 1,78(a)0l 

0 The new application being transmitted claims the benefit of prior U.S. applica- 
tion(s). Enclosed are ADDED PAGES FOR NEW APPLICATION TRANSMITTAL 
WHERE BENEFIT OF PRIOR U.S. APPLICATION(S) CLAIMED. 

3. Papers Enclosed 

A. Required for filing date under 37 C.F.R. § 1.53(b) (Regular) or 37 C.F.R. § 1.153 
(Design) Application 

Pages of specification 

1^ Pages of claims 

2 Sheets of drawing 

WARNiNG: DO NOT submit original drawings, A high quality copy of the drawings should be supplied when 
filing a patent application. The drawings that are submitted to the Office must be on strong, white, 
smooth, and non-shiny paper and meet the standards according to § 1.84. If corrections to the 
drawings are necessary, they should be made to the original drawing and a high-quality copy of 
the conected original drawing then submitted to the Office. Only one copy is required or desired. 
For comments on proposed then-new 37 CF,R. § 1.B4, see Notice of March 9, 1988 (1990 O.G. 
57-62). 

NOTE: "^Identifying indicia, if provided, should include the application number or the title of the invention, 
inventor's name, docket number Of any), and the name and telephone number of a person to call if 
the Office is unable to match the drawings to the proper application. This information should be placed 
on the back of each sheet of drawing a minimum distance of 7.5 cm. (5/8 inch) down from the top 
of the page . . 37 C.F.R. § 1.84(c)). 

(complete the following, if applicable) 

□ The enclosed drawing(s) are photograph(s), and there is also attached a 
"PETITION TO ACCEPT PHOTOGRAPH(S) AS DRAWING(S).'' 37 C.F.R. 
§ 1.84(b). 

□ fomnal 

□ informal 

B. Other Papers Enclosed 

Pages of declaration and power of attorney (copy from parent case) 

-1 Pages of abstract 

Other 

4. Additional papers enclosed 

□ Amendment to claims 

□ Cancel in this applications claims before 

calculating the filing fee. (At least one original independent claim must be 
retained for filing purposes.) 

□ Add the claims shown on the attached amendment. (Claims added have 
been numbered consecutively following the highest numbered original 
claims.) 

H Preliminary Amendment 

□ Information Disclosure Statement (37 C.F.R. § 1 .98) 

□ Form PTO-1449 (PTO/SB/08A and 08B) 

□ Citations 
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□ Declaration of Biologicat Deposit 

□ Submission of "Sequence Listing," computer readable copy and/or amendment 
pertaining thereto for biotechnology invention containing nucleotide and/or 
amino acid sequence, 

□ Authorization of Attomey{s) to Accept and Follow Instructions from Representa- 
tive 

□ Special Comments 

□ Other 

5. Declaration or oath (including power of attorney) 

NOTE: A newiy executed declaration is not required in a continuation or divisional application provided that 
the prior nonprovistonai application contained a declaration as required, the application being filed is 
by ail or fewer than all the inventors named m the prior application, there /s no new matter in the 
application being filed, and a copy of the executed declaration filed in the pnor application (showing 
the signature or an indication thereon that it was signed) is submitted. The copy must be accompanied 
by a statement requesting deletion of the names of person(s) who are not inventors of the application 
being filed. If the declaration in the prior application was filed under § 1.47, then a copy of that 
declaration must be filed accompanied by a copy of the decision granting § 1.47 status or, if a nonsigning 
person under §1.47 has subsequently joined in a prior application, then a copy of the subsequently 
executed declaration must be filed. See 37 C.f.R §§ 1.$3(d)(1H3), 

NOTE: A declaration filed to complete an application must be executed^ identify the speafication to which ft 
is directed, identify each inventor by fuli name including family name and at least one given name, without 
abbreviation together with any other given name or initial, and the residence, post office address and 
country or citizenship of each inventor, and state whether the inventor is a sole or joint inventor 37 
CF.R. § 1.63(a)(1H'^), 

NOTE: Vhe inventorship of a nonprovistonai application is that inventorship set forth in the oath or declaration 
as prescribed by § 1.62, except as provided for in § 1.53(d)(4) and § 1.63(d), If an oath or declaration 
as prescribed by§ 1.63 is not filed during the pendency of a nonprovisional application, the inventorship 
is that inventorship set forth in the application papers filed pursuant to § 1.53(b), unless a petition under 
this paragraph accompanied by the fee set forth in § 1.17ft) is filed supplying or changing the name 
or names of the inventor or inventors." 37 C.F.B. § 1.41(a)(1). 

E Enclosed 
Executed by 

(check all applicable boxes) 
S lnventor{s). (copy ^'^om parent case) 

□ legal representative of inventor(s). 
37 C.F.R. §§ 1.42 or 1.43. 

□ joint inventor or person showing a proprietary 
interest on behalf of inventor who refused to sign 
or cannot be reached. 

□ This is the petition required by 37 C.F.R. § 1 .47 and the statement 
required by 37 C.F.R. § 1.47 is also attached. See item 13 below 
for fee. 

□ Not Enclosed. 

NOTE: Where the filing is a completion in the U.S. of an international /^plication or where the completion of 
the U.S. application contains subject matter in addition to the intemationai Application, the application 
may be treated as a continuation or continuation-in-part, as the case may 6e, utilizing ADDED PAGE 
FOR NEW APPLICATION TRANSMITTAL WHERE BENEFIT OF PRIOR U.S. APPLICATION CLAUSED. 

□ Application is made by a person authorized under 37 C.F.R. § 1.41(c) on 
behalf of all the above named inventor(s). 
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fThe declaration or oath, afong with the surcharge required by 37 C.F.R. § 1.16(e) 

can be filed subsequently). 

□ Showing that the filing is authorized. 

(not required unless called into question. 37 C.F.R. § 1.41(d)) 

6. Inventorship Statement 

WARNING: if the named inventors are each not the inventors of a// the claims an explanation, including the 
ownership of the vanous claims at the time the last claimed invention was made, should be 
submitted. 

The inventorship for all the claims in this application are: 
XX The same. 

or 

□ Not the same. An explanation, including the ownership of the various claims at 
the time the last claimed invention was made, 

□ is submitted. 

□ will be submitted. 

7. Language 

NOTE: An application including a signed oath or declaration may be filed in a language other than English. 
An English translation of the non-English language application and the processing fee of $130.00 
required by 37 C.F.R. § 1.1 7(k) is required to be ftled with the application, or within such time as may 
be set by the Office. 37 C.F.R. § 1.52(d). 

g English 

□ Non-English 

□ The attached translation includes a statement that the translation is accu- 
rate. 37 C.F.R. § 1.52(d). 

8. Assignment 

S An assignment of the invention to FotoNation^ Inc, 



a is attached. A separate □ "COVER SHEET FOR ASSIGNMENT (DOCU- 
MENT) ACCOMPANYING NEW PATENT APPLICATION" or □ FORM PTO 
1595 is also attached. (assignment of parent application as recorded) 

□ will follow. 

NOTE: If an assignment is submitted with a new application, send two separate letters-one for the application 
and one for the assignment." Notice of May 4, 7990 (1114 O.G. 77-78), 

WARNING: A newly executed ^'CERTIFICATE UNDER 37 C.F.R. § 3. 73(b)'' must be filed when a continuation- 
in-part application is ftled by an assignee. Notice of April 30, 1993, 1150 O.G. 62-64. 
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9. Certified Copy 

Certified copy{ies) of application(s) 



Country 


Appln, No. 


Filed 


Country 


Appln. No. 


Filed 


Country 


Appln, No. 


Filed 



fronn which priority is clainned 

□ is (are) attached. 

□ win follow. 

NOTE: The foreign appiication forming the basis for the claim for priority must be referred to in the oath or 
declaration. 37 C.F.R 5 1.55(a) and 1,63. 

NOTE: This item is for any foreign priority for which the appiication being fifed directiy relates. If any parent 
U.S. appiication or Intemationai Application from which this application claims benefit under 35 U.S.C. 
§ 120 is itself entitled to priority from a orior foreign appiication, then complete item 18 on tfte ADDED 
PAGES FOR NEW APPLICATION TRANSMITTAL WHERE BENEFIT OF PRIOR US. APPUCAVON(S) 
CLAUSED. 

10. Fee Calculation (37 C.F.R. § 1.16) 
A. [3 Regular application 



CLAIMS AS FILED 


Number filed 




Number Extra 




Rate 


Basic Fee 
37 C.F.R. § 1.16(a) 
$690700- 710. ( 


Total 

Claims (37 C.F.R. 
§ 1.16(c)) 


27 - 


20 = 7 


X 


$ 18.00 


$126.00 


Independent 
Claims (37 C.F.R. 
§ 1.16(b)) 


4 - 


3 = 1 


X 


80.00 


$ 80.00 


Multiple dependent claim(s), 
if any (37 C.F.R. § 1.16(d)) 




+ 


$260.00 





^ Amendment cancelling extra claims is enclosed, 

□ Amendment deleting multiple-dependencies Is enclosed. 

□ Fee for extra claims is not being paid at this time. 

NOTE: If the fees for extra claims are not paid on filing they must be paid or the claims canceled by amendment, 
prior to the expiration of the time period set for response by the Patent and Trademark Office in any 
notice of fee deficiency. 37 C.F.R. § 1.16(d^. 

Filing Fee Calculation ^ 916.00 

B. □ Design appiication 

($310.00—37 C.F.R. § 1.16(f)) 

Filing Fee Calculation $ 
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C. □ Plant application 

($480.00—37 C.F.R. § 1.16(g)) 



Filing fee calculation $ 

11. Small Entity Statement(s) 

S Statement(s) that this is a filing by a smaii entity under 37 C.F.R. § 1 .9 and 1 .27 
is (are) attached. 

WARNING: "Status as a smai} entity must be specifically established in each application or patent in which 
the status is available and desired. Status as a small entity in one application or patent does not 
affect any other application or patent, including applications or patents which are directly or 
indirectly dependent upon the application or patent in which the status has been established. The 
refiling of an application under § 1,53 as a continuation, division, or continuation-in-part (including 
a continued prosecution application under § 1.53(d)), or the filing of a reissue application requires 
a new determination as to continued entitlement to small entity status for the continuing or reissue 
application. A nonprovisional application claiming benefit under 35 U.S.C. § 119(e), 120, 121, or 
365(c) of a prior application, or a reissue application may rely on a staterrtent filed in the prior 
application or in the patent if the nonprovisional application or the reissue application includes a 
reference to the statement in the prior application or in the patent or includes a copy of the 
statement in the prior application or in the patent and status as a small entity is still pn^per and 
desired. The payment of the small entity basic statutory Wing fee wilt be treated as such a reference 
for purposes of this section." 37 CF.R. § 1.28(aX2). 

WARNING: *'Small entity status must not be established when the person or persons ^gning the, . . statement 
can unequivocally make the required self-certification." M.P.EP., § 509.03, 6th ed,. rev. 2, July 
1996 (emphasis added). 

(complete the following, if applicable) 

Kl Status as a small entity was claimed in prior application 

_28 / 624,972 ^ fned on March 28, 1996 from which benefit 

is being claimed for this application under: 
35 U.S.C. § □ 119(e), 

m 120, 

□ 121, 

□ 365(c), 

and which status as a small entity is still proper and desired. 
S A copy of the statement in the prior application is included. 
Filing Fee Calculation (50% of A, B or C above) 

a; 458 > 00 

NOTE: Any excess of the full fee paid will be refunded if small entitiy status is estat)lished and a refund request 
are filed within 2 months of the date of timely payment of a full fee. The two-month period is not 
extendable under § 1.136. 37 C.F.R. § 1.28(a). 

12. Request for intemationai-Type Search (37 C.F.R. § 1.104(d)) 

(complete, if applicable) 

□ Ptease prepare an international-type search report for this application at the time 
when national examination on the merits takes place. 
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13. Fee Payment Being Macie at This Time 

□ Not Enclosed 

□ No filing fee is to be paid at this time. 

(This and the surcharge required by 37 C.F.R, § 1.16(e) can be paid 
subsequently.) 

M Enclosed 

a Filing fee $ ^^8-^00 

□ Recording assignment 
($40.00; 37 C.F.R. § 1.21(h)) 

(See attached "COVER SHEET FOR 
ASSIGNMENT ACCOMPANYING NEW 

APPLICATION".) $ 

□ Petition fee for filing by other Itian all the 
inventors or person on behalf of the inventor 
where inventor refused to sign or cannot be 
reached 

($130,00; 37 C.F.R. §§ 1.47 and 1.1 7(i)) $ 

□ For processing an application with a 
specification in 

a non-English language 

($130.00; 37 C.F.R. §§ 1.52(d) and 1.1 7(k)) $ 

□ Processing and retention fee 

($130,00; 37 C.F.R. §§ 1.53(d) and 1.21(1)) $ 

□ Fee for international-type search report 

($40.00; 37 C.F.R. § 1.21(e)) $ 

NOTE: 37 CF.R § 1.21(f) establishes a fee for processing and retaining any application that is abandoned for 
failing to compiete the application pursuant to 37 C.F.R, § 1.53(f) and this, as well as the changes to 
37 C.F.R. §§ 1.53 and 1. 78(a)(1), indicate that in order to obtain the benefit of a pnor U.S. application, 
either the basic filing fee must be paid, or the processing and retention fee of § 1.210 must be paid, 
within 1 year from notification under § 53(f). 

Total fees enclosed $ 

14. Method of Payment of Fees 

a Check in the amount of $_4iajlD 

□ Charge Account No. in the amount of 

$ 

A duplicate of this transmittal is attached, 

NOTE: Fees should be itemized in such a manner that it is clear for which purpose the fees are paid. 37 C.F.R. 
§ 1.22(b). 
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15. Authorization to Charge Additional Fees 

WARNING: if no fees are to be paid on filing, the following items should not be completed. 

WARNING: Accurately count claims, especially multiple dependent claims, to avoid unexpected high barges, 
if extra claim charges are authorized, 

}□ The Commissioner is hereby authorized to charge the following additional fees 
by this paper and during the entire pendency of this application to Account No. 

03T3975 : 

□ 37 C.F.R. § 1.16(a), (f) or (g) (filing fees) 

□ 37 C.F.R. § 1.16(b), (c) and (d) (presentation of extra claims) 

NOTE: Because additional fees for excess or multiple dependent claims not paid on Wing or on later presentation 
must only be paid or these daims cancelled by amendment prior to the expiration of the time period 
set for response by the PTO in any notice of fee deficiency (37 C.F.R § 1, 16(d)), it might be t>est not 
to authorize the PTO to diarge additional daim fees, except possibly when deafing with amendments 
after final action. 

□ 37 C.F.R. §1.1 6(e) (surcharge for filing the basic filing fee and/or declaration 
on a date later than the filing date of the application) 

□ 37 C.F.R. § 1.17(a)(l)-(5) (extension fees pursuant to § 1.136(a)). 

□ 37 C.F.R. § 1.17 (application processing fees) 

NOTE: . A written request may be submitted in an application that is an authorization to treat any concurrent 
or future reply, requiring a petition for an extension of time underthis paragraph for its timely submission, 
as incorporating a petition for extension of time for the appropriate length of time. An authorization to 
charge all required fees, fees under § 1,17, or al! required extension of time fees will be treated as a 
constructive petition for an extension of time in any concunent or future reply requiring a petition for 
an extension of tirrm under this paragraph for its timely submission. Submission of the fee set forth in 
§1,1 7(a) will a/so be treated as a constructive petition for an extension of time in any concunent reply 
requiring a petition for an extension of time under this paragraph for its timely submission. " 37 C.F.R, 
§ 1,13S(a)(3). 

□ 37 C.F.R. § 1.18 (issue fee at or before mailing of Notice of Allowance, 
pursuant to 37 C.F.R. § 1.311(b)) 

NOTE: Where an authorization to charge the issue fee to a deposit account has been filed t>efore the mailing 
of a Notice of Allowance, the issue fee will be automatically charged to the deposit account at the time 
of mailing the notice of allowance. 37 C.F.R § 1.311(b). 

NOTE: 37 C.F.R. § 1.28^^) requires "Notification of any change in status resulting in loss of entitlenmnt to small 
entity status must t>e filed in the application . . . prior to paying, or at the time of paying, . . .the issue 
fee, . . " From the wording of 37 C.F.R § 1.28(b), (a) notification of change of status must be made 
even if the fee is paid as "other than a small entity" and (b) no notification is required if the change 
is to another small entity. 
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16. Instructions as to Overpayment 

NOTE; . . Amounts of twenty-five dollars or less will not be returned unless specifically requested withm 
a mesonable time, nor will the payer be notified of such amounts; amounts over twenty- five dollars may 
be returned by check or, if requested, by credit to a deposit accounf* 37 C.F.R. § 1, 26(a). 

a Credit Account No. 03-3975 

□ Refund 



Reg. No. 32,243 



Tel. No. ( 650) 233-4500 



Customer No. 24729 




David H, Jaffer 



(type or orint name of attorney) 

PILL^URY MADISON & SUTRO 

2550 Hanover Street 

P.O. Address 

Palo Alto, CA 94304-U15 
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0: Incorporation by reference of added pages 

(check the following item if the application in this transmittal claims the t>eneflt of 
prior U.S. application(s) (including an international application entering the U.S. 
stage as a continuation^ divisional or C-l-P application) and complete and attach 
the ADDED PAGES FOR NEW APPLICATION TRANSMITTAL WHERE BENEFIT OF 
PRIOR as. APPLICATION(S) CLAIMED) 

M Pius Added Pages for New Application Transmittal Where Benefit of Prior U.S. 
Application(s) Claimed 

Number of pages added 5 

□ Plus Added Pages for Papers Referred to in Item 4 Above 

Number of pages added 

□ Plus added pages deleting names of inventor(s} named in prior appiicatjon(s) 
who is/are no longer inventor(s) of the subject matter claimed in this application. 

Number of pages added 

□ Plus "Assignment Cover Letter Accompanying New Application" 

Number of pages added 

□ Statement Where No Further Pages Added 

(if no further pages fonv a part of this Transmittal, then end this Transmittal with 
this page and check the following item) 

□ This transmittal ends with this page. 



(New Application Transmittal [4-1]— page 11 of 11) 



1" 



r 



Attorney's File No: 4423-03 

Applicant or Patentee: Eran Steinberg. Ha ri Vasudev and Sumat Mehra 
Serial/Patent Number: Filed/Issued . 

VERIFIED STATEMENT (DECLARATION) CLAIMING SMALL ENTITY 
STATUS (37 CFR 1.9(f) AND 1.27(c) - SMALL BUSI NESS CONCERN 

I am ( ) the owner of the small business concern identified below; 
(X) an official of the small business concern empowered to 
act on behalf of the concern identified below; 

Name of Concern: EPix Imaging Sys tems Inc . 
Address of Concern: 2953 Bunker Hill Lane. Suite 202 

Santa Clara. CA 95054 

I hereby declare that the above-identified small business concern 
qualifies as a small business concern as defined in 13 CFR 121.3 
18, and reproduced in 3 7 CFR 1.9(d) , for purposes of payxng reduced 
fees under section 41(a) and (b) of Title 35, United States Code, 
in that the number of employees of the concern, including those of 
its affiliates, does not exceed 500 persons. For purposes of this 
statement, (1) the number of employees of the business concern is 
the average over the previous fiscal year of the concern of the 
persons employed on a full time, part-time, or temporary basis 
during each of the pay periods of the fiscal year, and (2) concerns 
are affiliates of each other when either, directly or indirectly, 
one concern controls or has the power to control the other, or a 
third party or parties controls or has the power to control both. 

I hereby declare that rights under contract or law have been 
conveyed to and remain with the small business concern identitied 
above with regard to the invention entitled: INTELLIGENT CAMERA 
FLASH SYSTEM by Eran isteinberg, Hari Vasudev and Sumat Mehra 

described in 

(X) the specification filed herewith. 

( ) application Serial No. Filed 



( ) Patent No. Issued_ 



If the rights held by the above- identified small business concern 
are not exclusive, each individual, concern or organization having 
rights to the invention is listed below* and no rights to the 
invention are held by any person, other than the inventor, who 
could not qualify as a small business concern under 37 CFR 1.9 ^a; 
or by any concern which would not qualify as a small business 
concern under 3 7 CFR 1.9(d) or a nonprofit organization under 37 
CFR 1 . 9 (e) . 

*NOTE- Separate Verified Statements are required from each named 
person, concern, or organization having rights to the invention 
averring to their status as small entities (37 CFR 1.27) 

NAME: ■ — — 

ADDRESS * . 

( ) INDIVIDUAL ( ) SMALL BUSINESS ( ) NONPROFIT ORG. 



File No. 4423-03 



I acknowledge my duty to file, in this application or patent, 
notification of any change in status resulting in loss of 
entitlement to small entity status prior to paying, or at the time 
of paying, the earliest of the Issue Fee or any Maintenance Fee due 
after the date on which status as a small entity is no longer 
appropriate (37 CFR 1,28 (b)). 

I hereby declare that all statements made herein of my own know- 
ledge are true and that all statements made on information and 
belief are believed to be true; and further that these statements 
were made with the knowledge that willful, false statements and the 
like so made are punishable by fine or imprisonment, or both, under 
section 1001 of Title 18 of the United States Code, and that such 
willful, false statements may jeopardize the validity of the 
application, any patent issuing thereon, or any patent to which 
this Verified Statement is directed. 



NAME OF PERSON SIGNING: Joe Mikelonis 

TITLE: Vice President, Operations 

ADDRESS OF PERSON SIGNING: 2 953 Bunker Hill Lane, Suite 202 

Santa Clara, CA 95954 



SIGNATURE: 
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Practitioner^s Docket No. 29033-0269592 ^^^^ 

IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 

In re appiication of: Steinberg, et al. 

Application No.: 08 / 624,972 Group No.: 2712 

Filed: March 28, 1996 Examiner: Harrington, A. 

For: INTELLIGENT CAMERA FLASH SYSTEM 

Assistant Commissioner for Patents 
Washington^ D.C. 20231 

NOTinCATION OF FILING OF CONTINUING, 
DIVISIONAL OR CONTINUED PROSECUl ION APPLICATION 

Notification is hereby being nnade of the filing of a: 
B continuation 

□ continuation-in-part 

□ divisional 

□ continued prosecution 
application for this case 

S concun-ently herewith. 

□ on 

Date 



CERTIFICATION UNDER 37 C.F.R. §{ 1.8(a) and 1.10 

(When using Express Matt, the Express Mail label numb&r is mmndmtory; 
Express Mail certif/eation is opHonaL) 

1 hereby certify that, on the date shown below, this correspondence is being: 

MAIUNG 

IS deposited with the United States Postal Service in an envelope addressed to the Assistant Commissioner 
for Patents, Washington, D.C. 20231 

37 C.F,R. § 1.8(a) 37 CRR. § 1,10* 

□ with sufficient postage as first class ntail. B as "Express Mail Post Office to Addressee" 

Mailing Label No {mandatory) EL596839659US 

TRANSMISSION 




Signature 

Date- November 20, 2000 




Diana Dearing 



{type or print name of person certifying) 
^WARNING: Each paper or fee filed by Express Mai! must have the number of the "Express Mail" mailing label 
placed thereon prior to mailing, 37 C.f.R § 1.10(b). 

"S/nce the filing of correspondence under § 1. 10 without the Express Mail mailing label thereon 
is an oversight that can be avoided by the exerdse of reasonable care, requests for waiver of this 
requirement will not be granted on petition. " Notice of Oct. 24, 7996, 60 /=ed. Reg. 56,439, at 56M2. 
(Notification of Filing of Continuing, Divisional or Continued Prosecution Application [4-9] {page 1 of 2)) 



Reg. No. 32,243 

Tel. No.: ^50 ) 233-4500 

Customer No,: 24729 




David H. Jaffer 

(type or print name of pracdtfonet^ 

PILLSBURY MADISON & SUTRO 
2550 Hanover Street 



P.O. Address 

Palo Alto, CA 94304-1115 
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ADDED PAGES FOR APPLICATION TRANSMITTAL WHERE BENEFIT OF 
PRIOR U A APPUCATION(S) CLAIMED 



NOTE: See 37 CF.a § 1J8. 

17. RoiateBack 

WASWINQ: If an applicathn dwms the benefit of the mk^ date o 

§§ 120, 121 or365(c), the 20--year term of that applkmtk)n wSI t)e t)as0d 

the earliest U.S. application that the apptication makes reference to under 35 U.S.C 5§ 120, 121 

or 365(4 (35 U.&C. § 154(^ does not tato into account, for the determination of the patent 

term, any apptication on which priority is dmmed under 35 US.a §§ 119, 36S(a) or 365^).) For 

a c-i-p appiication, applicant shot^d review whether any dwm in the patent that wilt issue is 

supported by m^eahierapf^ic^^ and, if not, the applicant shoMcons^ 

to the earlier fUed spplication. The term of a patent is not based on a dmrn-by^m approach. 

See Notice of April 14, 1995, 60 Fed. «^fir. 20,195, at 20,205. 

(complete the Mbwing, if apf^icable) 
® Amend the specification by inserting, before the first line, the following sentence: 

A. 35 U.S.C. § 119(e) 

NOTE' 'Any nonprovisional application dwnmg the benefit of one or more pn^ 

implications must contmn or be amended to contain in the first sentence of the specification following 
the title a retemnce to each such prior pro¥^ionalapplica^,ident^ 

and inducSng the provision^ ^)plication number (consisting of aeries code md serial mffnber).' 37 CF-A 

□ "This application claims the benefit of U.S. Provisional Application{s) No(s).: 



APPUCATiON HO{S)Jt FIUNQ DATE 



(Added Paoes for Applicabon Transmittal Where Benefit of Prior U^. App!»calk)n(s) Claimed 

[4-1-1Hpa9e 1 of 5) 



B. 35 U.S.C. §§ 120, 121 and 365(c) 

NOTE: "Except for a continued prosecution applicadon fifed under § 1.53(d), any nonprovisional appiication 
claiming the bensHt of one or more prior filed copending nonprovisionai applications or intemationai 
applications designating the United States of America must contain or be amended to contain in the 
first sentence of the speciftcation following the title a reference to each such prior application, identifying 
it by application number (consis^ng of the series cocte and seriai number) or intemationai application 
number and intemationai fthng date and indicating the relationship of the applications. . . . Cross- 
references to other related applications may be made when appropriate." (See § 1,1 4(a)). 37 C.FR. 
§ 1 •78(a)(2). 

S "This application is a 

Q continuation 

□ continuation-in-part 

□ divisional 

of copending applicatlon{s) 

B application number 0 8/MIu222 filed on March 2ft. T' QQ^ 

□ International Application . filed on 

and which designated the U.S." 

NOTE: The proper reference to a prior filed PCT application that entered the US. national phase is the US, 
serial number and the filing date of the PCT applicat'on that designated the U.S. 

NOTE: (1) Where the application being transmitted adds subject matter to the Intemationai Application, then 
the filing can be as a continuation-in-part or (2) if it is desired to do so for other reasons then the filing 
can be as a continuation. 

NOTE: The deadline for entering the nadonal phase in the U.S. for an intemationai application was clarified 
in the Notice of April 28, 1987 (1079 O.G. 32 to 46; as follows: 

'The Patent and Trademark Office considers the Irttemational application to be pending until the 22nd 
month from the priority date if the United States has been designated and no Demand for Intemationai 
Preliminafy Examination has been filed prior to the expiration of the 19th month from the priority date 
and until the 32nd month from tiw priority date if a Demand for Intemationai Preliminary Examination 
which elected the United States of America has been filed prior to the excretion of the 19th month 
from the priority date, provicted that a copy of tiie intemationai application has been communicated 
to tiie Patent and Trademark Office within the 20 or 30 month period respectively. If a copy of tiie 
intemationai application has not been communicated to the Patent and Trademafk Office witiiin tiie 
20 or 30 month period respectively, the intemationai appiic&tion tiecomes abandoned as to the United 
States 20 or 30 montiis from tiie priority date respectivley. These periods have been placed in tiie mles 
as paragraph (h) of § 1.494and paragraph & of § 1.495. A continuing application under 35 US.C.36S(c) 
and 120 may be filed anytime raring the pendency of the intemationai apf^ication." 

□ "The nonprovisional application designated above, namely application 

/ — , filed , claims the benefit of 

U.S. Provisional Application(s) No(s).: 



APPUCATION NO(S).: HUNG DATE 

/ " 

/ « 

/ « 

□ Where more than one reference is made above, please combine all references 
into one sentence. 



(Added Pages for Application Transmittal Where Benefit of Prior U.S. Appiication(s) Claimed 
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18. Itolate Back— 35 U.S.C. § 119 Priority Claim for Prior Application 

The prior U.S. application(s), including any prior International Application designating the 
U.S., Identified atxjve in item 17B, In tunr^ Itself claim(s} foreign priority{ies) as follows: 



Country Appln. no. Filed on 

The certified copy{ies) has (have) 

□ been filed on , in prior application 0 / . which was 

filed on . 

□ is (are) attached. 

WARNINO: The certified copy of the priority application that may have been communicated to the PTO by 
the ktterrmtktnai Bureau rriay not t)e relied on without any need to 1^ 

application in the continuing appttoation. This is so because the certified copy of the priority 
application communicated by tt}e International Bureau is placed in a folder and is not assigned 
a US, serial numt>er unless the riational stage is entered Such folders are disposed of if the M 
ste^ is not entered. Therefore, such oertlfied copies may not i)e avaH^ if needed later In the 
prosecution of a conthuing applicatm. An aitemative would be to physicafy remove the priority 
docurr}ertts from the folders and transfer them to the continuing application. The resources required 
to request transfer, retrieve the folders, nt^ suited record nots^ons,tran^ 
erfter and make a record of such copies in the Contint^ngApf^tion are substantial. According, 
the priority documents in folders of international applications that have not entered the national 
sts^ may not be relied on, Atotrce of April 28, 1987 0079 0.& 32 to 46), 

19. Malntmiaiica of Copondoncy of Prior J^ipllcation 

A07H: The FHV ^nds it useful if a copy of the petition filed in the prior applicati^ 

response is Hied wi^ the papers constituting the filing of the continuation appHcation, Notioe of 
November 5, 198$ (1060 0,Ci 27). 

A. □ Extension of tinr>e in prior application 

(TNs item must be completed and the papers filed In the prior apfrilcatlon, 
If the period set In the f^r application has mn.) 

□ A petition, fee and response extends the term in the pending prior application 
until 

□ A c^^ of the petition filed in prior application is attached. 

B. □; CoTKlitional Petitkxi for Extension of Time in Prior Application 

{complete tNs Item, if pre\rious item not appiicabto) 

□ A condittcxial petition for extensbn of tinrie is k>eing filed in the pencBng prior 
application. 

□ A copy of the conditional petition filed in the prior application is attached. 



(Added Pages for Applicakion Transmittal Where Benefit of Prior U.S. AppKcatMs) Claimed 
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20. Further Inventorship Statement Where Benefit of Prior Appiication(s) 
Claimed 

(complete applicable item (a), (b; and/or (c) below) 

(a) 13 This application discloses and claims only subject matter disclosed in the prior 
application whose particulars are set out above and the inventor(s} in this 
application are 

S the same, 

□ less than those named in the prior application. It is requested that the 
following inventor(s) identified for the prior application be deleted: 



(type name(s) of inventor(s) to be ddeted) 

(b) □ This application discloses and claims additional disclosure by amendment and 
a new declaration or oath is being filed. With respect to the prior application, 
the inventor(s) in this application are 

□ the same. 

□ the following additional inventor(s) have been added: 



(type name(s) of invenU3r(s) to be added) 
(c) The inventorship for all the claims in this application are 
Q the same. 

□ not the same. An explanation, including the ownership of the various claims 
at the time the last claimed invention was made 

□ is submitted. 

□ will be submitted. 



(Added Pages for Application Transmrttal Where Benefit of Prior U.S. Appncation(s) Ctaimed 
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21. Abandonment of Prior Application fif applicable) 

□ Please abandon the prior application at a time while the prior application is 
pending, or when the petition for extension of time or to revive in that application 
is granted, and when ^is appticatton is granted a filing date, so as to make this 
application copending with said prior application. 

NOTE: According to the Notice of May 13,1983(103, TMOG 6-7), the filing of a continuation or continuatton-in- 
part appfica^on is a proper response with respect to a petition for &ctension of time or a petition to 
revive and should include the express abandonment of the prior application conditioned upon the 
granting of tf)e petition and the granting of a filing date to the continuing application. 

22. Petition for Suspension of Prosecution for the lime Necessary to 
File an Amendment 

WARNING: Ihe claims of a new application may be fine^ly rejected in the ^rst Office action in those situations 
wtiere (A) the new application is a continuir^ applicadon of, or a sutsstituts for, an earlier application, 
and (B) ail the daims of the new application (1) are drawn to the same invention claimed in tfie 
earfier application, and 0 would have t)een pre^tefty finally rejected on the grounds of art of record 
in the next Office action if they had been entered in the earlier application,' MP.E^ § 706,07(b), 
7th ed. 

NOTE: Where it is possible that the claims on file will give rise to a first action Unal for this continuation application 
and for some reason an amendment cannot 6e fHed promptly (e.g., ej^^erimentat data is bmng gathered^ 
h may be desirable tof^a petition for suspension of prosecution for the time necessary. 

(check the next item, if applicable) 

□ There is provided herewith a Petition To Suspend Prosecution for the Time 
Necessary to File An Amendment (New Application RIed Concunrently) 

23. Small Entity (37 C.F.R. § 1.28(a}) 

g Applicant has established small entity status by the filing of a statement in parent 
application 08 /624.972 nn March 28. 1996 

m A copy of the statement previously filed is included. 
WARNINQ: See 37 C.F,R. § 1.28(si. 

WARNING: ''Sniailentitystatusmustnotbeestablisijed when the person or persons siting tiie. . .statement 
can unequivocally make the required self-certification.'' M.P.EP., § $09.03, 7th ed. (emphasis 
added^. 

24. NOTIFICATION IN PARENT APPUCATION OF THIS FlUNG 

[1 A notification of the filing of this 
(chedc one of the following) 

IS continuation 

□ continuation-in-part 

□ divisional 

is being filed in the parent application, from which this application claims priority under 35 
U.S.C. § 120. 

(Added Pages for Application Transmittal Where Benefit of Prior U.S. App$icat}on(s) Claimed 
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IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 

Applicants: Steinberg et al. Docket No. 29033-026-9592 

Serial No.: Continuation of 08/624,972 

For: INTELLIGENT CAMERA FLASH SYSTEM 

PRELIMINARY AMENDMENT 

Commissioner of Patents and Trademarks 
Washington, D.C. 20231 

Dear Sir: 

In response to the Office Action in the parent application dated January 24, 2000, 
Applicants respectfully request that the claims be amended as follows: 

In the Claims 

Cancel claims 1, 9-10, 14, 17, and 23-25. 
In claim 2, line 1 : Change "claim 1" to -claim 28-. 
In claim 3, line 1 : Change "claim 1" to -claim 28~. 
In claim 4, line 1 : Change "claim 1" to -claim 28-. 
In claim 5, line 1 : Change "claim 1" to -claim 28-. 
In claim 7, line 1 : Change "claim 1" to -claim 28-. 
In claim 15, line 1 : Change "claim 14" to -claim 29-. 
In claim 16, line 1 : Change "claim 14" to -claim 29-. 
In claim 18, line 1 : Change "claim 18" to -claim 30-. 
In claim 19, line 1 : Change "claim 18" to -claim 30-. 
In claim 20, line 1 : Change "claim 18" to -claim 30-. 
In claim 21, line 1 : Change "claim 18" to -claim 30-. 
In claim 22, line 1 : Change "claim 18" to -claim 30-. 
In claim 26, line 1 : Change "claim 26" to -claim 31-. 
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1 28. (new) A flash method operable each time a flash picture is taken with a digital 

2 camera, said method comprising performing the following steps with the camera each time the 

3 camera takes a flash picture: 

4 a) activating a flash with a flash energy lower than the energy normally 

5 required for an acceptable final flash energy level for achieving a correct 

6 exposure; 

7 b) grabbing an image of a subject located a distance from said camera to create 

8 image intensity data; 

^ 9 c) analyzing said image intensity data to determine a flash degree of exposure, 

ifiO wherein the analyzing does not require knowledge of said distance; 

]%1 d) calculating a subsequent flash energy level to achieve a corrected degree of 

□2 exposure; 

13 e) repeating steps (a) through (d) until the acceptable final flash energy level 

!l4 for achieving a correct exposure is determined; and 

:S^5 f) activating a flash at the determined acceptable final flash energy; 

16 wherein each of steps (a) through (f) is performed automatically each time the camera takes a 

17 flash picture. 

1 29. (new) A flash method operable each time a flash picture is taken with a digital camera, said 

2 method comprising performing the following steps with the camera each time the camera takes a 

3 flash picture: 

4 a) activating a flash with a first flash energy lower than the energy normally 

5 required for an acceptable final flash energy level; 

6 b) grabbing a first image of a subject located a distance from said camera to 

7 create first image intensity data; 
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8 c) analyzing said first image intensity data to determine a first degree of 

9 exposure, wherein the analyzing does not require knowledge of said 

1 0 distance; 

11 d) scaling said first flash energy to determine a final flash energy level; and 

12 e) activating said flash at said final flash energy level for taking a picture; 

13 wherein each of steps (a) through (e) is performed automatically each time the camera takes a 

14 flash picture. 

1 30. (new) A flash apparatus operable each time a flash picture is taken with a digital 

Q 2 camera, said apparatus comprising: 

3 a) means for activating a flash with a flash energy lower than the energy 

ij 4 normally required for an acceptable final flash energy level for achieving a 

C 5 correct exposure; 

6 b) means for grabbing an image of a subject located a distance from said 

Z 1 camera to create image intensity data; 

g 8 c) means for analyzing said image intensity data to determine a flash degree of 

9 exposure, wherein the analyzing does not require knowledge of said 

1 0 distance; 

11 d) means for calculating a subsequent flash energy level to achieve a corrected 

1 2 degree of exposure; 

13 e) means for repeating steps (a) through (d) until an acceptable final flash 

1 4 energy level for achieving a correct exposure is determined; and 

15 f) means for activating a flash at the determined acceptable final flash energy; 

1 6 wherein the apparatus is integrated with the camera and operates automatically each time the 

1 7 camera takes a flash picture 
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1 31. (new) A flash apparatus operable each time a flash picture is taken with a digital 

2 camera, said apparatus comprising: 

3 a) means for activating a flash with a first flash energy lower than the energy 

4 normally required for an acceptable final flash energy level; 

5 b) means for grabbing a first image of a subject located a distance fi*om said 

6 camera to create first image intensity data; 

7 c) means for analyzing said first image intensity data to determine a first 

8 degree of exposure, wherein the analyzing does not require knowledge of 

said distance; 

ao d) means for scaling said first flash energy to determine a final flash energy; 

ifll and 

e) means for activating said flash at said final flash energy level for taking a 

;13 picture; 

:3[4 wherein the apparatus is integrated with the camera and operates automatically each time the 

: 4 5 camera takes a flash picture. 



REMARKS 

Applicants have cancelled claims 9-10 and 23-24, which were allowed in the parent case. 
Claims 1, 14, 17, and 25 are also cancelled, and claims 28-31 are presented. Claims 28, 29, 30, 
and 31 correspond to claims 1, 14, 17, and 25, respectively, of the parent case (as most recenfly 
amended). For convenience, we have shown changes to claims 28-31 as if amending former 
claims 1, 14, 17, and 25, as pending prior to the Office Action in the parent case dated January 
24, 2000. 
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Section 102 Rejection 

Item 1 of the Office Action dated January 24, 2000, in the parent case states that 

'^Ota discloses flash energy level control can be determined by 
distance information or color information,^^ 

and 

"/Y would have been obvious to one of ordinary skill in the art at 
the time the invention was made that flash control does not have to 
be distance based calculation,''^ 

Applicant respectfully traverses this argument. Ota does not disclose the use or control of a flash 

for taking a picture. Ota only discloses control of exposure by adjusting the iris and shutter 

(column 13, lines 35-39). Applicants' claims describing flash control are therefore not described 

by Ota . 

Item 2 of the Office Action rejects claims 4, 13, 16 and 27 imder 35 U.S.C. 112, 2'''^ 
paragraph, as indefinite because ''the Examiner is unclear to applicant's intended meaning^ 
The use of the terminology "minimum flash energy level" is considered unclear since the final 
flash energy is stated as higher than the previous flash energy in the base claims. Applicants 
acknowledge the need to clarify the claims and have amended claim 28 accordingly to change 
"energy required" in line 6 to "energy normally required." This change avoids claiming that the 
final flash is higher in energy than the preliminary flashes. The "minimum" flash of claims 4, 
13, 16 and 27 is a minimum preset value that is used when all of the pre-flashes indicate an over- 
exposed condition. Applicants believe this amendment clarifies claims 4, 13, 16 and 27, and that 
they are now distinguishable over Yamamoto and Ota and are allowable. 

Item 3 of the Office Action dated January 24, 2000, in the parent case rejects claims 1-5, 
7, 8, 11, 12-20, 22, and 25-27 under 35 U.S.C. 103(a) as being unpatentable over Yamamoto in 
view of Ota. Regarding independent claiml of the parent claim (claim 28 as presented herein), 
Yamamoto does not disclose a calibration that occurs each time a picture is taken. Yamamoto 's 
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process is a one-time factory calibration and requires distance information. Thereafter, for each 
picture taken, the Yamamoto camera measures the distance to the subject and refers to the 
factory cahbration to set the flash energy. No pre-flashes are used. AppHcants are unaware of a 
camera that is known to automatically adjust a flash by using pre-flashes and analyzing 
corresponding image data prior to taking each pictme. Ota does not teach the use of a flash and 
controlling a flash to achieve proper exposure. Ota teaches adjusting the iris and shutter. 
Applicants respectfiiUy request specific reference to publications or products prior to the filing 
date of the parent application that perform the processes according to claims 28-31 (claims 1, 14, 
17, and 25 of the parent case) in order to verify the corresponding statements in the Office 
Action. Applicants believe that independent claims 28-31 as amended are clarified and are now 
allowable. 

Regarding independent claim 14 of the parent case (claim 29 as presented herein), the 
Office Action states 

"Since grabbing an image means taking a picture, the steps are done during 
taking a picture. 

In explanation, when a consumer takes a picture with Yamamoto ' s camera, the camera measures 
the distance to the subject and with this information refers to a factory calibration chart in camera 
memory which gives the required flash energy data from which the camera activates the flash. 
This is an entirely different procedure from that defined by any of the independent claims 28-31. 
Yamamoto 's camera does not use a pre-flash and analyze corresponding image data to determine 
a flash energy level when a picture is taken by a consumer. The only repetitious use of flashes in 
the Yamamoto disclosure are those required to determine the factory calibration chart, which is a 
one lens manually assisted process performed at the factory. In explanation, the Yamamoto 
process is directed to a one-lens factory calibration of the camera, and therefore does not meet 
the requirement of claim 29 which requires that the process be done each time a flash picture is 
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taken. In order to further distinguish the independent claims 28-31 from Yamamoto , Applicants 
have added the limitation that the steps be performed automatically. The calibration procedure 
of Yamamoto requires operator's invention in addition to pressing a shutter button. 

Regarding independent claims 17 and 25 of the parent case (claims 30 and 31 as 
presented herein) , these claims are apparatus claims corresponding to the method claims 1 and 
14 of the parent case. As a result, the Office Action's reasons for rejection are essentially the 
same as those given in reference to claims 1 and 14 of the parent case. Applicants' response is 
also the same as stated above in reference to claims 1 and 14 of the parent case (claims 28 and 29 
as presented herein). The Yamamoto camera does not contain apparatus for performing pre- 
flashes and evaluating corresponding image data to determine a flash energy each time a picture 
is taken. 

In summary of the above. Applicants believe that independent claims 28-31 are now 
allowable, and that the remaining dependent claims are also allowable in adding further 
limitation to allowable claims. 

CONCLUSION 

Applicants respectfully request a Notice of Allowance. If any further questions should 
arise prior to allowance, the Examiner is invited to contact the undersigned at the number set 
forth below. 

Respeomilly snbmitted, 

David H.jiei/ U/ 
Reg. No. 3i243 
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PILLSBURY MADISON 8c SUTRO 
2550 Hanover Street 
Palo Alto, CA 94304-1115 
(650) 233-4510 

CERTIFICATE OF MAILING 

No. ^L^-j ^tj(^r^ 6/^ 

I hereby certify that this correspondence is being deposited with the United States Postal Service on the date shown 
below with sufficient postage as Express Mail in an envelope addressed to: Assistant Commissioner for Patents, 
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1 Specification 

2 

3 INTELLIGENT CAMERA FLASH SYSTEM 

4 

5 BACKGROUND OF THE INVENTION 

6 

7 Field of the Invention 

8 The present invention relates generally to electronic 

9 digital cameras , and more particularly to a digital camera using 

10 a pre-flash in combination with digital camera image acquisition 

11 apparatus and a processor for creating a histogram to determine 

12 an optimum flash power controlled through calculation of flash 

13 capacitor voltage. 
14 

15 Brief Description of the Prior Art 

IS Prior art cameras have used many different techniques to 

17 achieve optimum exposure, from hand held light meters to built 

18 in automatic exposure systems with flash. One method of 

19 controlling exposure is based on "through the lens" flash 

20 control in which the flash is terminated when sufficient light 

21 is collected by a photo receptor in the camera. Another method 

22 uses an infrared photo diode to measure the light. The 

23 advantage of using infrared is that in the infrare'd zone, light 

24 is more evenly reflective as a function of color in the visible 

25 spectrum. These methods are all based on an average 

26 (integration) over the entire image, and are not able to 

27 separate out important image areas for priority in setting the 

28 amount of light for exposure. For example, a combination of a 

29 close image and a distant background will result in a "washed 

30 out" foreground. Since primary subjects are often in the 

31 foreground; this is a serious problem in automatic exposure 

32 systems. These exposure control systems also require a very 

33 fast electronic switching device for a fast flash and a separate 

34 photo receptor which add complexity and cost to the system. The 

35 infrared receptor also has a problem in that the light measured 
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1 is only a monochromatic estimation of the scenery. This 

2 estimation may be close in some cases, but in others, it 

3 accentuates the problem of film/CCD metamerism, a condition 

4 where different wavelengths in a scene are improperly recorded. 

5 In Coltman et al . , U.S, Patent No. 4,998,128 the 

6 reflectivity of a subject is determined by pulsing a flash unit 

7 for predetermined short period of time. The light is detected 

8 by both visible and infrared light detectors, the outputs of 

9 which are integrated and used to select an optimum aperture and 

10 speed setting for taking the picture. In Taylor, U.S. Patent 

11 No, 4,066,884 an adjustable filter is used to vary the light 

12 intensity from an electronic flash unit, the degree of 

13 adjustment being empirically determined for a particular type of 

14 camera, in this case cameras designed for use with explosive 

15 flashbulbs which have relatively long duration of light 

16 intensity. The problem with the electronic flash unit when used 

17 with cameras having automatic exposure adjustment is that the 

18 time duration of the electronic flash is too short for the 

19 automatic exposure system to work. In Winter, U.S. Patent No. 

20 4,549,801, an electrically operated flash camera employs an 

21 infrared flash reflected light signal stored in a single memory 

22 storage to control focus and aperture. In Ishida, U.S. Patent 

23 No. 4,256,995, an electronic flash is disclosed which is capable 

24 of emitting light for a longer duration of time so as to allow 

25 automatic exposure control camera systems to function. 

26 Kabayashi et al . , U.S. Patent No. 4,717,934 discloses a flash 

27 used prior to image acquisition to determine the amount of flash 

28 required for an adequate exposure. This is done by detecting 

29 and integrating light radiated directly from the flash, and 

30 integrating the reflected light from the object. The flash 

31 power is provided by a separate capacitor from the capacitor 

32 used- for the main flash, 

33 In Coltman, the pre-flash system functions independently 

34 from the camera image acquisition apparatus, depending on a 
3 5 predetermined look up table , The accuracy of this method is 
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1 limited to the exactness of the correlation between the look up 

2 table and the actual setting. The mechanical adjustment device 

3 of Taylor for control of the flash intensity is dependent on the 

4 skill of the operator in knowing where to set the flash cover. 

5 In Winter, the burden of adjusting for exposure is placed 
5 entirely on the camera aperture and shutter speed. No attempt 

7 is made to control the amount of flash. The device of Ishida 

8 similarly does not use control of the flash time as an aid in 

9 achieving proper exposure but simply provides a flash of long 

10 duration, allowing conventional camera automatic exposure 

11 systems to function as if the lighting were ambient. This 

12 system would consume larger amounts of flash power than what 

13 would otherwise be required for proper exposure. The device of 

14 Kabayashi requires a separate capacitor for pre-f lashing, which 

15 involves extra cost and space. 

16 It is apparent from the above references that an improved 

17 camera is desirable, that conserves flash power and minimizes 

18 cost and space. Also, an improved camera would provide a method 

19 for evaluating light from different parts of an image to 

20 determine optimum exposure of particularly selected areas, this 

21 being a particular problem when objects are at various distances 
22. from the camera and when they are in contrast to each other. 

23 Such a camera would be a significant improvement over the prior 

24 art. 
25 

2 5 SUMMARY OF THE INVENTION 

27 It is therefore an object of the present invention to 

28 provide an improved digital camera having provision for 

29 determining optimum flash energy for illumination of a selected 

30 area of an image. 

31 It is a further object of the present invention to provide 

3 2 an improved digital camera using reduced energy flash 

33 illumination to determine optimum full flash energy. 

34 It is another object of the present invention to provide an 

35 improved digital camera having a flash system providing a series 
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1 of lower power flashes prior to a final flash utilizing a single 

2 capacitor and providing for optimum use of flash energy. 

3 It is another object of the present invention to provide an 

4 improved digital camera that uses the image acquisition 

5 apparatus to determine optimum camera exposure parameters from 

6 a low energy flash prior to a final flash. 

7 It is a further object of the present invention to provide 

8 a camera having a method of estimating an acquired image from 

9 data collected from low energy pre-f lashes. 

10 It is a still further object of the present invention to 

11 provide a camera that determines flash exposure based on center 

12 weight subsampling. 

13 It is another object of the present invention to provide a 

14 method for determining the energy of sequential flashes 

15 (strobes) based on the discharge curve of the flash capacitor in 

16 a digital camera. 

17 It is a further object of the present invention to provide 

18 a method of determining flash exposure based on samplings of an ' 

19 image luminous histogram. 

20 Briefly; a preferred embodiment of the present invention 

21 includes an intelligent flash system for a digital camera having 

22 components including an image optical pickup, an interface 

23 circuit; a flash unit and a processor. Upon activation of the 

24 camera, ambient lighting conditions are evaluated and if flash 

25 energy is required, a first low energy flash is radiated, the 

26 reflected light received by the optical pickup having a 

27 multiplicity of pixels, and the output of the pixels converted 

28 to image intensity data by the interface circuit. The processor 

29 samples the image intensity data, weighing the center image area 

30 more heavily, and creates a histogram plot of quantity of pixels 

31 v.s. intensity, and separates the plot into a bar graph from 

32 which a determination of exposure is obtained. The histogram is 

33 then used to calculate a multiplicative scaling factor used to 

34 multiply the first flash energy as an estimate of a final flash 

35 energy for correct exposure. Conditions of extreme over and 
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1 under exposure result in the activation of a second flash at an 

2 adjusted energy level. The image data of the second flash is 

3 then analyzed and the exposure compared with the result of the 

4 first flash. A final determination of flash energy is then made 

5 based upon the results. 

6 An advantage of the present invention is the provision of 

7 a flash system for a digital camera that provides optimum flash 

8 energy. 

9 A further advantage of the present invention is that it 

10 provides a flash system that uses reduced energy flashes in the 

11 determination of exposure, thus conserving total flash energy. 

12 Another advantage of the present invention is the provision 

13 of a flash system that conserves flash energy and operates from 

14 a single flash capacitor. 

15 A further advantage of the present invention is the use of 

16 the image acquisition optics to determine exposure, thus 

17 providing increased accuracy and a reduced parts cost, 

18 It is a further advantage of the present invention to 

19 provide a flash system that determines exposure based on center 

20 weight sampling, giving greater importance in exposure 

21 determination to a more important area of the image. 
22 

23 IN THE DRAWINGS 

24 Fig. 1 shows a block diagram of a digital camera according 

25 to the present invention/ 

26 Fig. 2 is an overall block diagram of the intelligent flash 

27 system; 

28 Fig. 3 is a block diagram showing further details of the 

29 method of achieving correct exposure; 

30 Fig. 4A is a sample image area illustrating the selection 

31 of a selection of a preferred object area; 

32 -Fig. 4B illustrates the weighted sampling of the preferred 

33 object area of Fig. 3A; 

34 Fig, 5 is a simplified array of pixel intensities; 
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1 Fig, 6A is a simplified histogram and bar graph based on 

2 the image intensity data of Fig,4; 

3 Fig. 6B is a table of the quantities of pixels and their 

4 intensities before and after scaling; 

5 Fig. 7 is a block diagram illustrating the method of 

6 exposure determination using the bar graph; 

7 Fig. 8 is a more realistic histogram before and after 

8 scaling; 

9 Fig. 9 is a block diagram showing the method of determining 

10 a scaling factor; 

11 Fig. 10 is a block diagram illustrating the determination 

12 of flash capacitor cutoff voltage; 

13 Fig. 11 is a schematic of a flash circuit; and 

14 Fig. 12 is a detailed block diagram showing the analysis of 

15 the image resulting from activation of a second flash. 
16 

17 DESCRIPTION OF THE PREFERRSD EMBODIMENT 

18 A typical camera system in which the method and apparatus 

19 of the present invention is employed is shown in Fig. 1, wherein 

20 a digital camera 10 is illustrated having a multiprocessor 12 

21 activated by shutter activator 14 through line 16, and 

22 communicating through bus 18 with image interface circuit 20. 

23 The multiprocessor further communicates with memory 22 through 

24 bus 24 and interconnects with the flash unit 26 through bus 28. 

25 Image optical pick-up 30 is interconnected to the image 

26 interface circuit 20 through bus 32, A power supply 34 is shown 

27 for providing electrical energy to the various circuit 

28 components through lines not shown. 

29 In response to the shutter activator 14, light 36 from an 

30 image to be recorded is received by the image optical pick-up 30 

31 and sent via bus 32 to the image interface circuit 20 which 

32 communicates with the pick-up 30 and processor 12 to provide 

33 digital image intensity data corresponding to the light 36, 

34 Further details of the pick-up 30 and circuit 20 are not 

35 necessary for an understanding of the present invention. Those 
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1 skilled in the art of digital cameras will know how to fabricate 

2 the light to digital data apparatus. 

3 According to Fig. 2, a user can select (block 38) one of 

4 two modes, including an AUTO MODE (block 40) or a MANDATORY 

5 FLASH MODE (block 42) . In either of the two modes. Auto or 

6 Mandatory Flash, the processor 12 is configured to respond to 

7 the activator 14 by sampling and analyzing the ambient light 

8 (blocks 44 and 46) to determine if it is adequate. In the Auto 

9 Mode, if the ambient light is found (block 48) to be adequate, 

10 the picture is taken without a flash (block 50) . If the ambient 

11 light is not adequate and a flash is needed (52) the camera 

12 parameters (block 54) are set for what is defined as a "full 

13 flash mode" at which point the flash is adjusted for optimum 

14 exposure and the picture is taken (block 55) . This process 

15 includes a series of one or more flashes applied to determine an 

16 optimum flash energy for proper exposure. The first flash is 

17 preset at a lower energy generally considered to result in 

18 "under" exposure. If the light from the first flash is adequate 

19 for an analysis, the image is analyzed and an estimate of a 

20 proper flash energy for a correct exposure is made and the 

21 picture is taken at this flash energy. If the light from the 

22 first flash is not sufficient for an analysis, a second flash is 

23 activated at a higher energy level. The preferred embodiment 

24 provides for a maximum of two flashes prior to a flash activated 

25 to take a picture. Alternate embodiments however can use any 

26 number of flashes prior to the final flash. When sufficient 

27 light for an analysis is provided by a flash, the processor 12 

28 scales the flash energy level to determine an estimated flash 

29 energy level for correct exposure and the camera takes the 

30 picture at this energy level. 

31 In the preferred embodiment, if the second flash energy 

32 level is insufficient for an analysis, i.e. resulting in either 
3 3 extreme under or over exposure, no further analysis is done. 

34 The picture is then taken (block 58) at a minimum flash energy 

35 level if the second flash caused extreme over exposure or at a 
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1 maximum flash energy level if the result of the second flash was 

2 extreme under exposure . 

3 The mandatory flash mode 42 results in the use of a flash 

4 regardless of the ambient lighting conditions, the purpose being 

5 to use the flash to fill shadows, such as on a subject person's 

6 face caused by bright sunlight. If the evaluation of ambient 

7 light (45) results in a determination (60) that a flash is 

8 needed {62), the camera parameters are set (54) as described 

9 above and the process continues according to the operations 

10 defined for blocks 56 and 58. If the ambient light is adequate, 

11 camera parameters are set 66 to reduce the ambient light input 

12 to the camera. The parameter adjustments in this case could 

13 include an increase in speed and/or a reduction in the camera 

14 aperture. The correct flash power is then determined and the 

15 picture is taken as explained above according to the operations 

16 associated with blocks 56 and 58 . 

17 The deliberate use of a low energy first flash is for the 

18 purpose of conserving flash capacitor energy so that the flash 

19 capacitor will subsequently have enough energy for a proper 

20 final flash without recharging. This method saves energy and 

21 eliminates the need for a separate flash capacitor for the 

22 flashes prior to the final flash. 

23 Referring again to Fig. 1, the light 36 from the flash is 

24 reflected from an object, received by the pick-up 30 and 

25 converted to a multiplicity of analog signals, each 

26 corresponding to one pixel in an array. These analog signals 

27 are then processed into digital image intensity data by the 

28 circuit 20 and sent to the processor 12. This process of 

29 conversion of the light to image intensity data will be termed 

30 "grabbing the image" in the following text. 

31 A more detailed description of the process of analyzing the 

32 image to determine exposure and a proper final flash will now be 

33 given. This description is somewhat complicated in the fact 

34 that the process is generally applicable to the two sources of 
3 5 light, i.e. from ambient or other secondary light and from a 
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1 flash/ as indicated in blocks 44, 46 and 56. In order to avoid 

2 having to repeat a lengthy description/ the following analysis 

3 will generally apply to both situations, with emphasis on the 

4 use of flash energy. The differences will be explained as the 

5 description proceeds. 

6 In general, the camera 10 responds to the low energy first 

7 flash, or to a first ambient light sample by grabbing a first 

8 image (or first ambient image to distinguish the use of ambient 

9 light) and creating first image intensity (or first ambient 

10 image intensity) data. The processor 12 then constructs a first 

11 histogram and first bar graph from sampled first image intensity 

12 data, and from an analysis of this data determines a first 

13 degree of exposure, i.'e, whether the object needs more or less 

14 light or whether the exposure is correct. In the above, the 

15 terminology generally also applies to an ambient/secondary light 

16 source. The terminology can be distinguished from the use of 

17 flash energy by replacing the terms first histogram, first bar 

18 graph and first degree of exposure with first ambient histogram, 

19 first ambient bar graph and first ambient degree of exposure. 

20 These distinctions will now be implied in the following 

21 descriptions without repetit iously making note of them, 

22 If the amount of light (first degree of exposure) is 

23 correct, a second flash or sampling is bypassed and the first 

24 flash energy level (or camera parameters for ambient light) is 

25 used to take the picture. In the case of ambient light (blocks 

26 44 or 46) , an automatic adjustment of camera parameters (speed, 

27 F-stop) would be made if the degree of exposure were not 

28 adequate. If the exposure is adequate, the picture is taken 

29 with ambient light and original parameters. If the exposure is 

30 not correct, but a meaningful histogram was created in the 

31 analysis, i.e., if the image was not greatly over or under 

32 exposed, a scaling procedure is performed on the sampled first 

33 image intensity data. This scaling procedure is performed by 

34 the processor by finding a first scaling factor to the first 

35 sampled intensity data so as to cause a predetermined percentage 
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1 (.5% preferred) of the pixels to be above the saturation value 

2 of the image optical pickup (preferably a CCD) . This scaling is 

3 accomplished by multiplying the sampled first image intensity 

4 data by the first scaling factor and reconstructing and re- 

5 analyzing the histogram to determine the number of pixels with 

6 intensities exceeding the saturation value. Upon finding the 

7 proper scaling factor in the case when the camera is analyzing 

8 an image from a flash, the processor uses this factor as an 

9 energy scaling factor^ by which to multiply the first flash 

10 energy level to obtain an estimated correct final flash energy 

11 level. The picture is then taken with this estimated final 

12 flash energy. If the light source is ambient with no flash; the 

13 scaling factor is used with a look-up table or as an appropriate 

14 factor to determine an adjusted set of camera parameters. If 

15 the result from ambient light is a condition of extreme under 

16 exposure to such an extent that no camera speed or aperture 

17 adjustment will correct it; the camera automatically shifts to 

18 the full flash mode (block 54) and the above process is 

19 activated- as described in relation to the use of a first and 

20 second flash. 

21 In either the case of ambient or flash light sourceS; the 

22 above described scaling is not performed if the degree of 

23 exposure is extremely under exposed (low clipping) or extremely 

24 over exposed (high clipping) ; since a meaningful histogram 

25 cannot then be prepared. If a meaningful histogram is not 

26 obtained from the first flash, due to either extreme under 

27 exposure (low clipping) or extreme over exposure (high 

28 clipping) ; a second flash at a second flash energy level is 

29 activated; the second flash energy level being at an adjusted 

30 fraction of the first flash. If the first degree of exposure is 

31 extremely under exposed (low clipping) ; the second flash energy 

32 level is adjusted to a greater energy level. If the first 

33 degree of exposure is extremely over exposed (high clipping) , 

34 the second flash energy level is adjusted to a lower energy 

35 level. A second image of the object: is then grabbed, and second 
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1 image intensity data is created from which sampled second image 

2 intensity data is taken and a second histogram and second bar 

3 graph are created therefrom. The second histogram and second 

4 bar graph are then analyzed and a second degree of exposure 

5 determined. If high or low clipping are still occurring, the 

6 flash energy is minimized or maximized respectively and a 

7 picture is taken. If the exposure is correct, the flash is 

8 again activated at the second flash energy level to take the 

9 picture. In the case of under or over exposure, i.e., moderate 

10 under or over exposure not resulting in clipping, a second 

11 scaling factor is determined and used as a multiplicative 

12 scaling factor on the second flash energy to determine an 

13 estimated correct final flash energy. The use of the term 

14 "under exposure" and "over exposure" in the following text will 

15 generally indicate moderate "over" or "under" exposure, rather 

16 than extreme under or over exposure which will be alternatively 

17 termed low and high clipping , The above description using a 

18 maximum of two flashes prior to a final flash is the preferred 

19 embodiment, however, alternate embodiments include any number of 

20 flashes prior to a final flash and are included in the 

21 invention , 

22 The operation described in Fig. 2 can be more fully 

23 understood through reference to Fig. 3. The blocks 58-88 

24 included in block 90 give added detail to the operation of 

25 blocks 44-48, and 52-66 in Fig, 2. This determination of 

26 exposure in blocks 44 and 46 of Fig. 2 uses ambient light as the 

27 light sources. Block 56 uses a flash. In Fig, 3, block 90 more 

28 fully describes the activity of determining the exposure. Block 

29 68 indicates the activation of the light source, which is either 

30 a flash or a sampling of ambient light. 

31 The image is then grabbed (block 70) i.e., detected by the 

32 optical pick-up 30 (Fig. 1) and processed by the interface 

33 circuit 20 to digital image intensity data. The image intensity 

34 data is then analyzed to determine a degree of exposure. This 

35 analysis involves the following operations in blocks 71 and 72 
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1 including sampling of the image intensity data in a selective 

2 manner (block 71) in order to weigh more heavily the data 

3 representing the primary object area. This area is usually 

4 considered to be near the center of the image, and such sampling 

5 is to be considered part of the preferred embodiment; however, 

6 the processor 12 could be programmed to weigh other areas more 

7 heavily and they are included in the spirit of the invention. 

8 The sampled image data is then analyzed to determine the 

9 exposure (block 72) , and the activity is directed accordingly. 

10 If the condition is extreme overexposure, resulting in high 

11 clipping where the large majority of pixels are at the high end 

12 of the intensity range, the process is directed to block 74. If 

13 the condition is extremely under exposed, the process continues 

14 in block 76. Simple over or under exposure not resulting in 

15 clipping are directed to blocks 78 and 80 respectively, and if 

16 the exposure is correct, activity continues at block 92. 

17 The operations of blocks 74, 75, 78 and 80 all involve 

18 calculating either a subsequent flash energy or a subsequent set 

19 of camera parameters such as speed and aperture to sample a 

20 corrected amount of light to achieve a correct exposure. The 

21 calculation is either for a subsequent flash or ambient sample 

22 to be analyzed, or a final flash energy level or set of 

23 parameters for a final sample of ambient light to take the 

24 picture. In the case of severe over exposure the operations 

25 indicated by block 74 involve setting parameters to determine 

26 the energy of a second flash when a flash is the light source, 

27 or re-setting the camera parameters such as speed and aperture 

28 if ambient light is the source. For the flash case, block 74 

29 indicates one half of the energy of the first flash, but some 

30 other fraction could be used as well. Similarly, if the 

31 condition is extremely underexposed (low clipping) where nearly 

32 all -of the pixel intensities are near the low end of the 

33 intensity scale, parameters are set to direct a second flash at 

34 higher energy (block 76) . Although block 76 indicates doubling 

35 the energy, some other factor could be used. 
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1 If the condition is merely overexposed i.e. over exposed to 

2 a lesser degree and a detailed histogram can be prepared, the 

3 image data is adjusted (block 78) by a scaling factor until the 

4 histogram shows preferably .5% of the intensity data exceeding 

5 a predetermined intensity level, at which point the 
G corresponding scaling factor is used to scale down the first 

7 flash power, or is used to determine adjusted camera parameters. 

8 If the result of the analysis indicates a similar condition 

9 of under exposure to a lesser degree than low clipping so that 

10 a histogram can be created (block 80) , the processing is similar 

11 to the description above for overexposure. The scaling factor 

12 for under exposure would be greater than unity, which would 

13 increase the flash energy, 

14 If the first flash or ambient light sample results in a 

15 correct exposure 82 ^ the processor proceeds directly to block 92 

16 and the flash is activated at a power level equal to the first 

17 flash energy, or in the case of ambient light, the same quantity 

18 of light is admitted/sampled again. 

19 In the above cases involving over exposure 78, under 

20 exposure 80, and correct exposure 82, a second flash or sampling 

21 of ambient light is not required. When the analysis shows 

22 correct exposure, the corresponding flash energy is again 

23 activated or the sampled quantity of ambient /secondary light is 

24 again sampled (block 92), the image grabbed 94 and recorded 96. 

25 In the cases of high clipping 74 and low clipping 76, either a 

26 second flash is activated 84 at an adjusted energy level, or a 

27 second ambient light sample is admitted followed by the grabbing 

28 of the image 86 and further analysis 88 and decision making in 

29 order to arrive at a correct flash energy or setting of camera 
3 0 parameters. In the preferred embodiment, a maximum of two 

31 flashes occur before a final flash is activated to take the 

32 picture. A larger number of flashes prior to the final flash 

33 are also included in the invention and this is indicated by 

34 arrov/s 85 and 87 showing the operations from block 70 to 84 

35 repeated. This repetition can be any number of times according 
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1 to the programming. For example, smaller increments of flash 

2 energy adjustment in blocks 74 and 76 could be used, which could 

3 require more repetitions of analysis and adjustment to arrive at 

4 a useable flash energy from which to scale (block 78, 80) a 

5 final flash energy, or more adjustments of flash energy could be 

6 done before a final determination that the minimum or maximum 

7 flash energy should be used. Following the operation of block 

8 88, determining optimum flash energy or camera parameters, the 

9 light source (flash or ambient /secondary) is activated 98, the 

10 image grabbed 100 and recorded 102. This is all indicated by 

11 block 88, the details of which will be fully described in the 

12 following specification in reference to the figures of the 

13 drawing. 

14 The "sample image" block 71 of Fig. 3 is more fully 

15 described with reference to Figs. 4a and 4b. The image optical 

16 pick-up 30, such as a charged coupled device (CCD), contains 

17 thousands of individual receptors, i.e. pixels (picture 

18 elements) . An analysis of the output of each of these elements 

19 would be a very expensive project, and for this reason the 

20 pixels are sampled (block 71) . For example, suppose there were 

21 300,000 pixels. In order to bring the analysis down to a more 

22 economical level, 1000 of the pixels could be selected from the 

23 300,000. The number of pixels and the following numbers and 

24 graphs are given by way of illustration of the method and 

25 apparatus of the present invention, and are not to be considered 

26 as limiting, since any number of pixels or any sample quantity 

27 could apply. In the example selected for illustration, a 

28 significantly greater number of pixels are sampled from the 

29 center area relative to the edges since the center of the image 

30 usually contains the primary subjects of the photography. This 

31 selective sampling gives greater weight to the lighting of the 
3 2 more -important area of the image. For example, suppose square 
33' 104 of Fig. 4 is the total area of an image. For illustration, 

34 it is partitioned into a center region 106 and an edge region 

35 108. The camera can be set up to consider the center region 106 
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1 as being of greater importance. The area is arbitrarily 

2 selected for illustration to contain 4% of the pixels. The 

3 camera in this case would then weigh light intensity from the 

4 center 105 more heavily than the edge region 108, by sampling a 

5 larger number of pixels per unit area from the center region 

6 than from the edge region. For example, Fig. 4b represents a 

7 weighted sampled image of image 104. The original region 106 is 

8 now represented by region 110 occupying 25% of the total sampled 

9 image and region 108 represented by sampled region 112 in Fig. 

10 4b. In other words, a particular area of the image can be over 

11 sampled in order to weigh it as more important in determining 

12 what is a correct exposure. Although the preferred embodiment 

13 involves sampling the center region more heavily, alternate 

14 embodiments involve sampling more heavily in other areas, or in 

15 more than one selected area. 

16 Block 72 of Fig. 3 includes the creation of a histogram and 

17 multiple region bar graph from the sampled image data, and 

18 evaluation of the degree of exposure as high clip, over exposed, 

19 properly exposed, under exposed or low clip. For ease of 

20 wording, the terms over exposed and under exposed will generally 

21 be used to refer to moderate over or moderate under exposure, 

22 and not to include the more severe form of under or over 

23 exposure that places pixels at one or the other extreme of the 

24 intensity scale. These more severe forms are indicated by the 

25 terms low clip and high clip as referred to above, or low 

26 clipping and high clipping, or descriptively as extreme under or 

27 extreme over exposure, 

28 For ease of illustration of the histogram and bar graph 

29 process, suppose the grid of 25 pixels in Fig. 5 is the sampled 

30 image intensity data. Also, for simplicity, the light intensity 

31 values are assumed to have the range of 1 to 1000. Each square 

32 114 represents one pixel of the sampled image, and has a number 

33 assigned which is the value of light intensity of the pixel 

34 selected for illustrative purposes. In addition to sampling the 

35 image data, the processor 12 further simplifies and speeds 



4423-03 



-15- 




1 calculations by selecting a predetermined number of regions of 

2 intensity to create a bar graph to aid in the evaluation instead 

3 of evaluating each pixel. For this illustration, suppose the 

4 number of regions of light intensity selected is five, the first 

5 region being the number of pixels with light intensities of 1-2, 

6 the second having values of 3 and 4, the third, 5 and 6, the 

7 fourth 7 and 8 and the fifth, 9 and 10. 

8 Fig. 6A shows a histogram, i.e., a plot of pixel quantity 

9 versus light intensity with the original quantity of each light 

10 intensity recorded as small circles. The histogram of 

11 ''quantities" of pixels with a given intensity versus "intensity" 

12 is overlaid by the five region bar graph. Region 1 is 

13 represented by bar 116, region 2 by bar 118, region 3 by bar 

14 120, region 4 by bar 122 and region 5 by bar 124. Bar 124 is of 

15 zero height because there are no pixels in the corresponding 

16 intensity range, which is from intensities greater than 800, up 

17 to and including 1000, The height of bar 116 is the number of 

18 pixels having intensities from zero to 200, including one pixel 

19 at intensity 100 and five at intensity 200, for a total of 6 

20 pixels defining the height of the bar. The other bars are 

21 similarly derived. The modified bars 126-134 are outlined by 

22 dashed lines and are the result of the quantity of pixels having 

23 scaled intensity values, the quantities noted by the small x's. 

24 The purpose of the scaling is related to scaling in blocks 78, 

25 80 and 88 for the purpose of arriving at a scaling factor, which 

26 is used to multiply a previous flash to yield a correct final 

27 flash energy. This process will be fully described in the 

28 following discussions of the figures of the drawing. For 

29 example, the first region after intensity scaling has a quantity 

30 of pixels equal to one. The pixel initially had an intensity of 

31 100, which is noted by the "0" identified by item no. 138. 

32 After an analysis which will be fully explained, the intensity 

33 is multiplied by a scaling factor which moves the position of 

34 the quantity notation to the intensity 106.25 indicated by the 

35 "x" and identified by item no, 136, thus shifting its position 
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1 to the right on the intensity scale. The second "0" indicated 

2 by item no. 140 indicates a quantity of five pixels with 

3 intensity of 200. The scaling shifts this value above the 200 

4 limit of region 1 and into region 2 as noted by the second x 

5 identified by item no. 142. Therefore, the new region 1 has 

6 only one pixel as indicated by the dashed bar 126. A similar 

7 explanation follows for the other regions. Of particular note 

8 is region 5 which begins with no pixels, but due to the scaled 

9 values moving higher in intensity, the dashed/modified region 5 

10 has one pixel. Note also that because a multiplicative scaling 

11 factor was used, the horizontal distance (intensity difference) 

12 between the first "0" and the first "x" is much smaller than the 

13 intensity difference between the last "0" 144 and last "x" 146. 

14 For ease of reference, the quantities of pixels and their 

15 intensities before and after scaling are shown in the table of 

16 Fig. 6B. The above example will be referred to in the following 

17 detailed description of the exposure analysis performed by 

18 blocks 72 and the scaling operations performed in blocks 78, 80 

19 and 88 . 

20 The "analyze exposure" block 72 of Fig. 3 represents the 

21 creation and analysis of the bar graph of the actual sampled 

22 image intensity data. This analysis can now be more fully 

23 understood through reference to Fig, 7, Block 152 indicates the 

24 input of the sampled image from block 71 of Fig. 3, and blocks 

25 154 and 156 refer to the making of the histogram and bar graph 

26 as explained above in reference to Figs. 5 and 6. According to 

27 block 158, region 1 of the bar graph is evaluated and if it 

28 contains more than a preset high value, the exposure condition 

29 is termed low clipping (block 160). Similarly, in block 152, 

30 region 5 is evaluated and if it contains more than a preset 

31 value of pixels the exposure is- termed high clipping (block 

32 164) If neither high or low clipping occur, region 3 is 

33 evaluated (block 166) and if the number of pixels is found to be 

34 within preset upper and lower limits, the exposure is termed to 

35 be "ok" (block 168) . Otherwise, if region 3 has a high number 
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1 of pixels exceeding the upper limits, region 2 is evaluated 

2 (block 170) . If it has a low number of pixels, the exposure is 

3 "ok" (block 172); and if' not, the condition is overexposed 

4 (block 174) . If the region 3 (block 166) analysis shows the 

5 number of pixels below the low limit, region 4 is evaluated for 

6 a high number of pixels (block 176) . If it has a high number 

7 above a preset level, the exposure is "ok" (block 178), 

8 Otherwise, the condition is underexposed (block 180) . 

9 If the analysis indicates that nearly all the pixels have 

10 intensities in region 1, the exposure is termed "low clipping" 

11 or "low clip". If nearly all of the pixels have intensity in 

12 region 5, this would be high clipping (high clip) . If neither 

13 low or high clipping exists, the analysis proceeds to blocks 78 

14 or 80 in Fig. 3. Referring again to the simplified example of 

15 Figs. 5 and 6, and to Fig. 8, the scaling operations performed 

16 in blocks 78 and 80 can be more fully understood. The solid 

17 line bar graph of Fig. 6A is evaluated according to block 72 

18 explained above, and the condition would be noted as under 

19 exposed. A vertical line 148 (Fig. 6A) is marked showing the 

20 location of a value S equal to 850, S represents a point on a 

21 curve of "input light intensity" versus "output" of the image 

22 optical pickup 30 (curve not shown) where the curve becomes 

23 nonlinear, i.e. where the pickup begins to saturate, a condition 

24 indicative of excessive light input. A value "C" is also noted 

25 in Fig. 6A, marked with a line 150 as the value 800. The value 
2 6 " C" is supposed to be the point on the distribution of pixel 

27 intensities above which lie .5% of the pixels. This point is 

28 not clear in Fig. 6A because there are only 25 total pixels and 

29 .5% is less than one. For illustrative purposes, it is placed 

30 on the value 800 which includes the pixel of greatest intensity. 

31 According to a preferred embodiment of the present invention, a 

32 scaling factor S/C is defined, where S is as defined above, and 

33 C is the above defined value for a given distribution of 

34 unsealed pixels. The factor S/C is estimated by the processor 

35 12 and used in the cases of blocks 78 and 80 to either multiply 
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1 the first flash energy to obtain an estimated final flash energy 

2 for acceptable exposure, or to adjust the camera parameters if 

3 ambient light is the source. For example, in Fig, 6A, the ratio 

4 of S/C = 850/800 = 1.0625. For reference, Fig. 6B is a table 

5 giving the quantities and intensities before and after scaling 

6 for Fig. 6A. Multiplying a first flash energy by the factor S/C 

7 and activating the flash would result in a pixel intensity 

8 distribution as shown by the "x"'s in Fig. 6A, with a bar graph 

9 as indicated by the dashed lines. Note that the dashed lines 

10 are displaced horizontally from the solid lines so they can be 

11 seen, but in fact they are horizontally representative of the 

12 same intensity. Also note that the scaled plot has a pixel at 

13 the value S equal to 850, A more realistic distribution of 

14 pixels might be more instructive at this point, and such a 

15 distribution is shown in Fig. 8. The solid curve "H" represents 

16 an original distribution resulting from a first flash. The 

17 point "C" at intensity 700 is supposed to represent the 

18 intensity point above which .5% of the pixels lie. The dashed 

19 curve "H" represents the plot of the scaled intensities which 

20 should result if the pixels represented by the solid curve H are 

21 multiplied by the factor S/C. In the case of Fig. 8, the value 

22 of S/C is S/C = 850/700. Note the area above S = 850 in the 

23 dashed curve. It should represent .5% of the total number of 

24 pixels. A reverse process with an S/C less than unity would 

25 result if the point C were initially above the point S, i.e. S/C 

26 < 1. 

27 The scaling processes of blocks 78 and 80 are illustrated 

28 in -block form in Fig. 9. Block 182 indicates the need for the 

29 histogram of the sampled image from block 72. Block 184 

30 describes the need of the value S. Block 186 includes the 

31 operation of finding the point C on the histogram, above which 

32 .5% of the pixels lie. Block 188 gives the ratio of S/C as the 

33 scaling factor. 

34 Referring now to Figs. 10 and 11, the operations performed 

35 according to the "activate light source" blocks 92 and 84 can be 
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1 more fully understood in the case when the flash is used. Block 

2 190 defines the inputs required. These are the desired flash 

3 energy "Efi^3j,", the voltage on the flash capacitor "Vi", and the 

4 value of the flash capacitor "C" . The capacitance "C" of the 

5 flash capacitor is a constant, and is a predetermined, pre- 

6 programmed value. The desired flash energy "££^33^" is determined 

7 as described in relation to blocks 78 or 80, depending on 

8 whether the result of the first flash was a condition of over or 

9 under exposure, and is '^ti^^^ = S/C (E,) where is the previous 

10 flash- E^ is the energy of the first flash for the activate 

11 blocks 92 and 84, The determination of S/C was explained above 

12 for blocks 78 and 80. When a correct exposure condition is the 

13 result of the first flash, the value of S/C is unity. 

14 In the case where high or low clipping results from first 

15 flash or a first sampled ambient light, the scaling procedure of 
IS blocks 92 and 84 is not used. In these cases the scaling factor 

17 is a predetermined setting for flash operation, either 1/2 for 

18 high clipping or 2 for low clipping as indicated in blocks 74 

19 and 76, although other values are ,included in the spirit of the 

20 invention. The activate flash blocks 92 and 84 also define the 

21 operation of sensing the voltage Vi prior to a flash. 

22 With the above discussed values of E^^ash^ ^nd C, the 

23 processor 12 performs the calculation indicated in block 192 of 

24 Fig. 10 for Vc , Vc is the value of the flash capacitor voltage 

25 at which point the desired flash energy is expended in the flash 

26 unit. Solving the equation yields 

29 The flash operation described above is more fully explained 

30 in reference to Fig, 11, The figure shows a capacitor 194, 

31 switch 196 and flash bulb 198 arrangement. The voltage V across 

32 the capacitor terminals 200 and 202 is monitored. The value of 

33 Vi prior to a flash, as described above is measured and used in 

34 the calculation of a lesser value of voltage Vc at which point 

35 the capacitor 194 will have discharged the desired amount of 
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1 energy to the flash bulb 198. The transfer of energy from the 

2 capacitor 194 to bulb 198 begins when a signal on line 204 

3 causes switch 196 to connect line 200 to line 206 to the bulb 

4 198. When the voltage between lines 200 and 202 (across 

5 capacitor 194) is sensed to be equal to Vc, a second signal is 

6 applied on line 204 causing switch 196 to disconnect line 200 

7 from line 206 . 

8 Referring to Fig. 12, there is shown a block diagram 

9 detailing the operations indicated by the second exposure 

10 analysis block 88 of Fig. 3. As discussed in reference to Fig. 

11 3, if the exposure resulting from the first flash or first 

12 ambient light sample is either high or low clipping; a second 

13 flash or second ambient light sampling is performed of either 

14 lower or higher energy respectively for the flash, or adjusted 

15 parameters for the ambient light. This flash or sampling, 

16 described above in reference to block 84, provides an adjusted 

17 light to grab an image (block 86) which is analyzed according to 

18 block 88. 

19 According to Fig. 12, the grabbed image (block 85, Fig, 3) 

20 is passed as indicated by arrow 208, and is sampled (block 210) 

21 and then examined according to the "analyze exposure" block 212. 

22 Blocks 210 and 212 define the same operations on the image data 

23 of the second flash or second sample as blocks 71 and 72 perform 

24 on the image data from the first flash or first sample. 

25 Similarly, if the result of the analysis is a determination that 

26 the exposure is correct, the sequence of activities defined by 

27 blocks 214-220 is identical to that of blocks 92-96 of Fig, 3, 

28 This is in response to a correct exposure resulting from the 

29 first flash or first ambient light sample. The additional block 

30 220 indicates the option of supplying a notice to the operator 

31 that the exposure is okay. This notice can be in any of a 

32 variety of forms known to those skilled in the art, such as a 

33 light bulb of any color, or LED read out, etc. In the event the 

34 second flash results in low clipping (224) , the processor 12 

35 sets the flash to a maximum intensity as indicated by block 226. 
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1 The flash or sample is then activated (block 228) , the image is 

2 grabbed 230 and recorded 232. Similarly, if the second flash or 

3 second sample yields a high clip condition 234, the processor 12 

4 directs the flash to a minimum (236) . In the case where the 

5 light source was ambient light, the parameters are set for 
5 minimum light. The flash or sampling is then activated (228), 

7 the image grabbed (block 230) and recorded (232) . 

8 If the result of the second flash or second ambient sample 

9 is a condition of under exposure (238) meaning a condition not 

10 severe enough to be low clipping, and if the result of the first 

11 flash (240) or first sampling is under exposure 242, the second 

12 flash or sampling is scaled with a scaling factor S/C as 

13 indicated by block 244. The process of determining the scale 

14 factor S/C is the same as that described above in reference to 

15 block 80 of Fig. 3. The flash, or sampling is then activated 
IS (228) . In the case of a flash, the energy is set to a level 

17 equal to E^iS/C) where is the second flash energy and S/C is 

18 the scaling factor. In the case of ambient light, the 

19 parameters of the last sampling are scaled to adjusted 

20 parameters using the factor S/C and an optional look-up table. 

21 The image is then grabbed 230 and recorded 232. Similarly, if 

22 the first result is "over exposure" (246) , the preferred 

23 embodiment simply scales the second flash energy level or the 

24 camera parameters for ambient light (block 248) by determining 

25 the scale factor S/C. The determination of the scale factor S/C 

26 is again done in the same way as that described in relation to 

27 block 80 of Fig. 3 . 

28 In the case where the analysis of the sampled image of the 

29 second flash results in a condition of over exposure (250) , and 

30 the result of the first flash (252) is under exposure (254) , the 

31 second flash energy is scaled by the value S/C (block 248) to 

32 obtain the final flash energy. Also, if the first flash is over 

33 exposed (256), the second flash energy is again scaled (block 

34 258) by the value S/C for final flash energy. Similarly for an 

35 ambient light source, the camera parameters are scaled from the 
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1 parameters used in the second light sampling. The scaling 

2 operations in blocks 244, 248 and 258 are all similar to the 

3 scaling operations of blocks 78 and 80 as described in reference 

4 to Fig, 3. The only difference is that the scaling blocks of 

5 Fig, 12 scale the second flash energy or second camera 

6 parameters rather than the first. Also, it should be pointed 

7 out that scaling the ' second flash energy/parameter is done for 

8 simplicity in the cases where the second exposure image is under 

9 exposed and the first image is over exposed (ref, 238 and 246), 

10 and the case when the second image is over exposed and the first 

11 is under exposed (refs. 250 and 254). Alternate embodiments of 

12 the invention include exposure methods of scaling in block 248 

13 when the first and second exposure bracket the correct exposure. 

14 For example, in the case where the first exposure results in 

15 under exposure and the second results in over exposure, a 

16 weighted average could be used. For the flash case, an example 

17 could be to assume a final flash energy Ew = A(E2 - - E^ 

18 where A is a preset fraction between zero and one, the selected 

19 value depending on the estimated accuracy of the second flash. 

20 For example, it would normally be assumed that the second flash 

21 energy is closer to correct than the first and a choice of A = 

22 .7 might be selected. Other weighted averages are also included 

23 in the spirit of the present invention. 

24 The "Notice" blocks 260-268 define an optional visual or 

25 recorded message to the operator of the particular exposure 

26 condition existing when a picture is taken. 

27 Although a preferred embodiment of the present invention 

28 has been described above, it will be appreciated that certain 

29 alterations or modifications thereon will be apparent to those 

30 skilled in the art. It is therefore that the appended claims be 

31 interpreted as covering all such alterations and modifications 

32 that- fall within the true spirit and scope of the invention. 
33 

34 What is claimed is: 
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CLAIMS 

1 1. A flash method for a digital camera, said method 

2 comprising; 

3 a) activating a flash with a flash energy; 

4 b) grabbing an image to create image intensity data; 

5 c) analyzing corresponding image intensity data of an image 

6 derived from said flash to determine a flash degree of exposure; 

7 d) calculating a subsequent flash energy level to achieve 

8 a corrected degree of exposure; 

9 e) repeating steps (a) through (d) until an acceptable 

10 final flash energy level for achieving a correct exposure is 

11 determined; and 

12 f) activating a flash at the determined acceptable final 

13 flash energy, 

1 2. A method as in claim 1 further comprising a step prior to 

2 step (a) consisting of determining by analysis of ambient light 

3 or user election whether a flash is needed. 

1 3. A method as recited in claim 1 wherein said calculating 

2 includes multiplying the energy level of said flash by a pre-set 

3 constant factor if said flash degree of exposure is severely 

4 under exposed or severely over exposed. 

1 4, A method as recited in claim 1 wherein said calculating 

2 further includes 
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3 a) setting said subsequent flash energy level at the 

4 maximum flash energy level for a final flash energy level if two 

5 or more consecutive flash degrees of exposure are severely under 

6 exposed; and 

7 b) setting said subsequent flash energy level at a minimum 

8 flash energy level for a final flash energy level if two or more 

9 consecutive flash degrees of exposure are severely over exposed. 

1 5. A method as recited in claim 1 wherein said activating a 

2 flash with a flash energy includes 

3 a) detecting an initial voltage of a flash capacitor; 

4 b) calculating a cutoff voltage of said flash capacitor at 

5 which voltage a quantity of energy equal to said flash energy is 

6 transferred to power said flash; and 

7 c) transferring a quantity of energy equal to send flash 

8 energy to said flash. 

1 6. A method as recited in claim 1 wherein said analyzing 

2 includes 

3 a) sampling a first quantity of data from a first area of 

4 said image; and 

5 b) sampling a second quantity of data from a second area of 

6 said image . 

1 7. A method as recited in claim 1 wherein said analyzing 

2 further includes 
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3 a) creating a histogram of quantity of said image intensity 

4 data versus intensity; 

5 b) preparing a bar graph with a multiplicity of regions 

6 from said histogram; and 

7 c) evaluating the quantity of data in each said region of 

8 said bar graph, 

1 8. A method as recited in claim 7 wherein said calculating 

2 includes scaling said image intensity data to determine a 

3 scaling factor to multiply times said flash energy to calculate 

4 a final acceptable flash energy if said degree of exposure is 

5 under exposed or over exposed. 

1 9. A method as recited in claim 8 wherein said scaling said 

2 image intensity data includes 

3 a) evaluating said histogram to determine a first intensity 

4 level above which a predetermined percentage of said intensity 

5 data lie; and 

S b) dividing a predetermined intensity level selected as a 

7 level at which said grabbing to create image intensity data 

8 becomes non-linear, by said first intensity level to create said 

9 scaling factor . 

1 10. ^ A method as recited in claim 1, wherein said calculating 

2 includes calculating a weighted average of a first energy level 

3 of a flash which resulted in under exposure, and a second energy 
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4 level which resulted in over exposure to obtain an estimated 

5 final flash energy level, 

1 11. A method as recited in claim 2, wherein said determining by 

2 analysis includes 

3 a) sampling a quantity of ambient light with said camera 

4 having a first set of camera parameters; 

5 b) grabbing an image to create image intensity data; 

6 c) analyzing corresponding image intensity data of an image 

7 derived from said ambient light to determine an ambient degree 

8 of exposure; 

9 d) calculating subsequent camera parameters to sample a 

10 quantity of ambient light to achieve a corrected degree of 

11 exposure; and 

12 e) repeating steps (a) through (d) until a said set of 

13 camera parameters are determined resulting in an acceptable 

14 quantity of ambient light for achieving a correct exposure, or 

15 until it is determined that a flash is needed, 

1 12. A method as recited in claim 11 further comprising: 

2 sampling a quantity of ambient light equal to said 

3 acceptable quantity of ambient light. 

1 13. ^ A method as recited in claim 3 wherein said calculating 

2 further includes 
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3 a) setting said subsequent flash energy level at the 

4 maximum flash energy level for a final flash energy level if two 

5 or more consecutive flash degrees of exposure are severely under 

6 exposed; and 

7 b) setting said subsequent flash energy level at a minimum 

8 flash energy level for a final flash energy level if two or more 

9 consecutive flash degrees of exposure are severely over exposed. 

1 14 . A flash method for a digital camera, said method 

2 comprising : 

3 . a} activating a flash with a first flash energy; 

4 b) grabbing a first image to create first image intensity 

5 data; 

6 c) analyzing corresponding first image intensity data of 

7 said first image derived from said first flash to determine a 

8 first degree of exposure; 

9 d) scaling said first flash energy if said first degree of 

10 exposure is under or over exposed to determine a final flash 

11 energy level; and 

12 e) activating said flash at said final flash energy level. 

1 15, A flash method as recited in claim 14 further comprising: 

2 a) multiplying said first energy level by a pre -determined 

3 factor if said first degree of exposure is severely under 

4 exposed or severely over exposed to determine a second flash 

5 energy level; 
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6 b) activating said flash with said second flash energy 

7 level; 

8 c) grabbing a second image to create second image intensity 

9 data; 

10 d) analyzing corresponding second image intensity data of 

11 said second image derived from said second flash to determine a 

12 second degree of exposure; 

13 e) scaling said second flash energy level if said second 

14 degree of exposure is under exposed or over exposed to determine 

15 a final flash energy; and 

15 f) activating said flash with said final flash energy. 

1 16 . A flash method as recited in claim 15, further comprising: 

2 a) setting a final flash energy equal to a maximum flash 

3 energy if said second degree of exposure is severely under 

4 exposed; 

5 b) setting a final flash energy equal to a minimum flash 

6 energy if said second degree of exposure is severely over 

7 exposed; and 

8 c) activating said flash with said final flash energy. 

1 17 . A flash apparatus for a digital camera, said apparatus 

2 comprising : 

3 a) means for activating a flash with a flash energy; 

4 b) means for grabbing an image to create image intensity 

5 data; 



4423-03 



"29- 



6 c) means for analyzing corresponding image intensity data 

7 of an image derived from said flash to determine a flash degree 

8 of exposure ; 

9 d) means for calculating a subsequent flash energy level to 

10 achieve a corrected degree of exposure; 

11 e) means for repeating steps (a) through (d) until an 

12 acceptable final flash energy level for achieving a correct 

13 exposure is determined; and 

14 f) means for activating a flash at the determined 

15 acceptable final flash energy. 

1 18, An apparatus as in claim 17 further comprising means for 

2 determining by analysis of ambient light or user election 

3 whether a flash is needed. 

1 19. An apparatus as recited in claim 17 wherein said means for 

2 calculating includes means for scaling said image intensity data 

3 to determine a scaling factor to multiply times said flash 

4 energy to calculate a final acceptable flash energy if said 

5 degree of exposure is under exposed or over exposed, 

1 20, An apparatus as recited in claim 17 wherein said means for 

2 activating a flash with a flash energy includes 

3 _a) means for detecting an initial voltage of a flash 

4 capacitor; 
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5 b) means for calculating a cutoff voltage of said flash 

6 capacitor at which voltage a quantity of energy equal to said 

7 flash energy is transferred to power said flash; and 

8 c) means for transferring a quantity of energy equal to 

9 send flash energy to said flash, 

1 21. An apparatus as recited in claim 17 wherein said means for 

2 analyzing includes 

3 a) means for sampling a first quantity of data from a first 

4 area of said image; and 

5 b) means for sampling a second quantity of data from a 

6 second area of said image. 

1 22. An apparatus as recited in claim 17 wherein said means for 

2 analyzing further includes 

3 a) means for creating a histogram of quantity of said image 

4 intensity data versus intensity; 

5 b) means for preparing a bar graph with a multiplicity of 

6 regions from said histogram; and 

7 c) means for evaluating the quantity of data in each said 

8 region of said bar graph. 

1 23 . An apparatus as recited in claim 19 wherein said means for 

2 scaling said image intensity data includes 
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3 a) means for evaluating said histogram to determine a first 

4 intensity level above which a predetermined percentage of said 

5 intensity data lie; and 

6 b) means for dividing a predetermined intensity level 

7 selected as a level at which said grabbing to create image 

8 intensity data becomes non-linear, by said first intensity level 

9 to create said scaling factor. 

1 24 . An apparatus method as recited in claim 17, wherein said 

2 means for calculating includes means for calculating a weighted 

3 average of a first energy level of a flash which 'resulted in 

4 under exposure, and a second energy level to obtain an estimated 

5 final flash energy level. 

1 25. A flash apparatus for a digital camera, said apparatus 

2 comprising; 

3 a) means for activating a flash with a first flash energy; 

4 b) means for grabbing a first image to create first image 

5 intensity data; 

6 c) means for analyzing corresponding first image intensity 

7 data of said first image derived from said first flash to 

8 determine a first degree of exposure; 

9 d) means for scaling said first flash energy if said first 

10 degree of exposure is under or over exposed to determine a final 

11 flash energy; and 
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12 e) means for activating said flash at said final flash 

13 energy level . 

1 26. A flash apparatus as recited in claim 25 further 

2 comprising : 

3 a) means for multiplying said first energy level by a pre- 

4 determined factor if said first degree of exposure is severely 

5 under exposed or severely over exposed to determine a second 
5 flash energy level; 

7 b) means for activating said flash with said second flash 

8 energy level ; 

9 c) means for grabbing a second image to create second image 

10 intensity data; 

11 d) means for analyzing corresponding second image intensity 

12 data of said second image derived from said second flash to 

13 determine a second degree of exposure; 

14 e) means for scaling said second flash energy level if said 

15 second degree of exposure is under exposed or over exposed to 

16 determine a final flash energy; and 

17 f) means for activating said flash with said final flash 

18 energy. 

1 27. A flash apparatus as recited in claim 26, further 

2 comprising : 
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3 a) means for setting a final flash energy equal to a 

4 maximum flash energy if said second degree of exposure is 

5 severely under exposed; 

6 b) means for setting a final flash energy equal to a 

7 minimum flash energy if said second degree of exposure is 

8 severely over exposed; and 

9 * c) means for activating said flash with said final flash 
10 energy. 
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ABSTRACT OF THE DISCLOSUKE 

1 

2 An intelligent flash system for a digital camera having 

3 components including an image optical pickup, an interface 

4 circuit, a flash unit and a processor. Upon activation of the 

5 camera, ambient lighting conditions are evaluated and if flash 

6 energy is required, a first low energy pre-flash is radiated, 

7 the reflected light received by the optical pickup having a 

8 multiplicity of pixels, and the output of the pixels converted 

9 to image intensity data by the interface circuit. The processor 

10 samples the image intensity data, weighing the center image area 

11 more heavily", and creates a histogram plot of quantity of pixels 

12 v.s. intensity, and separates the plot into a bar graph from 

13 which a determination of exposure is obtained. The histogram is 

14 then used to calculate a multiplicative scaling factor used to 

15 multiply the first flash energy to an estimate of a flash energy 
15 for correct exposure. Conditions of extreme over and under 

17 exposure result in the activation of a second flash at an 

18 adjusted energy level. The image data of the second flash is 

19 then analyzed and the exposure compared with the result of the 

20 first flash. A final determination of flash energy is then made 

21 based upon the results. 
22 

23 

24 DHJ:RLF:02082 
25 



4423-03 



-35- 



1/9 






5— ( 




o 












GO 







o 




>k A A 



2/9 



User set up 
flash mode? 



•38 



40 



44 



Auto mode 




1 


Determine 


exposure 


w/b 


flash 








56 



FIG. 2 



52 
Yes 



Set flash 
parameters to: 
mil flash mode 



Determine 
exposure 
with flash 



Take picture 



Mandatory 
flash mode 



42 



Determine 
exposure 
w/o flash 



•46 




No 



66 



Set flash 
parameters to: 
mil flash mode 



58 



3/9 



68 

70 
11 



Activate/Sample 
Light 



I 



87 



Grab image 
1 



72 



Sample image 
I 



High 
Chppmg 



Over 

74 Exposed 



Cut flash energy 
by 1/2 





Scale 






Scale 


image 






image 



Under 

Exposed ^ 



Low 
Clipping 



Correct ^ 82 
Exposure 



3-4 



Double flash 
energy 

Set 
parameters 



84- 
86 

88- 



Activate/Sample 
Light 



Grab image 



r 

85 



To block 70 



Second exposure 
analysis 



92- 



94 



V V \f 



Activate/Sample 
Light 



Activate/Sample 
Light 



Grab image 



PJQ. 2 96^ Record image Record image 



90 



Grab image 



•98 

■100 
■102 



4/9 

104 

1 , 



106 



108 





110 




112 



FIG. 4A FIG. 4B 




500 


400 


300 


200 


200 


600 


300 


400 


500 


300 


400 


300 


600 


700 


400 


200 


500 


800 


700 


300 


100 


200 


300 


400 


200 



FIG. 5 



5/9 



12- 

11- 
10- 
9- 
8- 
7- 
6- 
5- 
4- 
3- 
2- 
1- 



118 



116 
140- 



126 138 136 

.A 



-ox- 



128 



"J 



OX- 



OX 

-142 



ox- 



130 
..i... 

120 

J_ 

ox 



c s 



150 



122 132 



1. 



ox 



ox 
144- 



148 



134 



r 

O'-X- 



146 



124 



1 \ \ 1 \ \ \ \ \ 

100 200 300 400 500 600 700 800 900 1000 



FIG. 6A 



INTENSITY 



FIG. 6B 



QTY 



Original 
Intensity 



Scaled 
Intensity 



1 


100 


106.25 


5 


200 


212.50 


6 


300 


318.75 


5 


400 


425.00 


3 


500 


531.25 


2 


600 


637.50 


2 


700 


743.75 


1 


800 


850.00 


0 


900 




0 


1000 





r 



6/9 



-1 



Given: 
Sampled 
Image 



Make 
Histogram 
of Image 



154 






72 



FIG. 7 



7/9 




FIG. 8 



100 200 300 400 500 600 700 800 900 1000 

INTENSITY 



Input: 
Histogram of 
Subsampled image 



188 



> 


^182 


Determine on the 
cummulative histogram 
the point of allowed 
clipping (C) 


< ' 






^186 

1 


Scale factor = S/C 





Set: 

CCD Saturation value (S) 



78,80 

FIG. 9 



8/9 



Given: 

Desired flash energy - E^j^g]^ 
Voltage on flash capacitor - Vj 
Flash capacitor capacitance - C 



Calculate cutoff voltage - Vc 



2 ^ 



yCVc^ -E flash 



190 



192 



FIG. 10 



92,84 



204 



V 



202 



200--^ 






r 


-196 




Switch 


r 








r 











FIG. 1 1 



206 




9/9 



FIG. 12 



88 



208 




> 




Subsample 
Image 




^210 


Analyze 
Exposure 




^212 


Activate 
Flash 




^214 


Grab 
Image 




^216 


Record 
Image 


> 


^218 


Notice: 
Exposure 
OK 



Low 224 
Clipping 



238 



240 



^250 
Over 



252- 



226 



Arbitrary Set Flash 
to Maximum 



r 



260 



Notice: 
Low 
Clipping 



Scale Image to OK 
exposure 
(increase flash) 



Notice: 
Under 
Exposed 



. Under 

First 
Pre-flash 
Exposure 

Over 246 



262 



248 



Scale Image to OK 
exposure 
(bracket flash) 

1 

Under ^ 228- 
First ^\ 
Pre-flash \> 230 
Exposure 

Over 256 

£258 



C 



264 





Notice: 







Exposure 


► 




OK 





Activate flash 



? 



Grab Image 
i 



Record Image 



High 234 
Clip 



Scale Image to OK 

exposure 
(decrease flash) 



r 



266 



Notice: 
Over 
Exposed 



Arbitrary cut down 
flash power to 
minimum 



Notice: 
High 
clippmg 



268 



COMBINED DECLARATION, POWER OF ATTORNEY & PETITION 



DECLARATION 



As a below-named inventor, I hereby declare that: 

(i) my residence, post office address and citizenship are as stated below next to my name; 

(ii) I have reviewed and understand the contents of the attached specification including the drawing and 
claims as amended by any amendment referred to below; 

(iii) I believe I am the original, first and sole inventor (if only one is listed below) or a joint inventor (if 
plural inventors are named below) of the invention entitled: 

INTELLIGENT CAMERA FLASH SYSTEM 

as described and claimed in the specification which 
H is attached hereto. 

□ was filed on as U.S. Patent Application Serial 

No. . 

□ was described and claimed in PCT International Application No. filed on 

and as amended under PCT Article 19 on . 

(iv) I acknowledge my duty to disclose information of which I am aware which is material to the examination 
of this application, in accordance with 37 CFR 1, 56(a); 

(v) I do not know and do not believe that the same was (1) ever known or used in the United States before 
my or our invention thereof, or (2) patented or described in any printed publication in any country before 
my or our invention thereof for more than one year prior to this application, or (3) in public use or on 
sale in the United States more than one year prior to this application; 

I declare further that all statements made above of my own knowledge are true and all statements made on 
information and belief are believed to be true; and these statements were made with the knowledge that willful 
false statements and the like so made are punishable by fine or imprisonment, or both, under Section 1001 of Title 
18 of the United States Code and such willful false statements may jeopardize the validity of the application or 
any patent issuing thereon. 

POWER OF ATTORNEY 

I hereby appoint the following patent attorneys and/or patent agent(s) with full power of appointment, 
substitution and revocation to prosecute this application, to make alterations and amendments thereto, to receive 
the patent, and to transact all business in the Patent Office connected therewith. 

DAVID H. JAFFER, Reg. No. 32,243 
JILL A. HUDSON, Reg. No. 37,716 



Attorney Docket : 4423-03 

U.S. DECLARATION, POWER OF ATTORNEY & PETITION 



Address ail telephone calls to David Jaffer at telephone number (408) 977-0120, and address all 
correspondence to: 

David H. Jaffer, Esq. 
ROSENBLUM, PARISH & ISAACS 

160 West Santa Clara St,, Fifteenth Floor 
San Jose, California 95113 



PETITION 

Wherefore, I pray that Letters Patent be granted to me for the invention or discovery described and 
claimed in the above-mentioned specification and claims, and I hereby subscribe my name to the foregoing 
Declaration, Power of Attorney & Petition with references to the above-mentioned specification and claims. 

SIGNATURES 

Name of sole or 

first inventor: Eran Steinberg 

Home Address: 372 Douglas Street 

Post Office Address: San Francisco, CA 94114 
Citizenship: Israel 

Inventor's Signaturc > ^^^^^^^^ ^^^^^^^^ Date: 



Name of 
second inventor: 



Hari Vasudev 



Home Address: 
Post Office Address: 
Citizenship: 

Inventor's Signature: 



1251 Vicente Drive, #103 
Sunnvvale, Ca 94086 
India 



Date: t^ARCM 



Name of 

third inventor: Sumat Mehra 



Home Address: 1527 Larkwood Court 
Post Office Address: Milpitas, CA 95035 
Citizenship: India 



Inventor's Signature: 




Date: ^Ayw^g.mL 



DHJ:RLF:0307x 



Attorney Docket: 4423-03 

U.S. DECLARATION, POWER OF ATTORNEY & PETITION 



Page 2 



